-- Logs begin at Tue 2022-09-06 19:25:57 UTC, end at Tue 2022-09-06 20:35:50 UTC. -- Sep 06 20:04:54.514131 dv-cinder-847732-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 20:04:54.526391 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 20:04:54 2022] *** Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: nodename: dv-cinder-847732-4-iscsi Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: machine: x86_64 Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: clock source: unix Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: pcre jit disabled Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: detected number of CPU cores: 4 Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: current working directory: / Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: detected binary path: /usr/bin/uwsgi-core Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: your processes number limit is 47680 Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: your memory page size is 4096 bytes Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: detected max file descriptor number: 2048 Sep 06 20:04:54.528733 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: lock engine: pthread robust mutexes Sep 06 20:04:54.530495 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: thunder lock: enabled Sep 06 20:04:54.530495 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 20:04:54.530495 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 20:04:54.570001 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: Python main interpreter initialized at 0x563f82f2d9c0 Sep 06 20:04:54.570001 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: python threads support enabled Sep 06 20:04:54.570001 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: your server socket listen backlog is limited to 100 connections Sep 06 20:04:54.570001 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: your mercy for graceful operations on workers is 90 seconds Sep 06 20:04:54.570402 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 20:04:54.570497 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: *** Operational MODE: preforking *** Sep 06 20:04:54.570750 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: *** uWSGI is running in multiple interpreter mode *** Sep 06 20:04:54.570750 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: spawned uWSGI master process (pid: 105836) Sep 06 20:04:54.571022 dv-cinder-847732-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 20:04:54.572077 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: spawned uWSGI worker 1 (pid: 105837, cores: 1) Sep 06 20:04:54.572077 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: spawned uWSGI worker 2 (pid: 105838, cores: 1) Sep 06 20:04:54.572077 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 20:04:55.279681 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 20:04:55.299194 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 20:04:56.496970 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:56.496970 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: from cryptography.utils import int_from_bytes Sep 06 20:04:56.498245 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:56.498245 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: from cryptography.utils import int_from_bytes Sep 06 20:04:56.507579 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:56.507579 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: from cryptography.utils import int_from_bytes Sep 06 20:04:56.508461 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:56.508461 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: from cryptography.utils import int_from_bytes Sep 06 20:04:59.443973 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 20:04:59.444725 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 20:04:59.445220 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 20:04:59.445372 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 20:04:59.445372 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 20:04:59.445692 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 20:04:59.445835 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 20:04:59.445977 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 20:04:59.446233 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 20:04:59.446369 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 20:04:59.446845 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.446993 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.447370 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.447518 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.447899 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.448020 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.448401 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.448508 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.448939 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.449037 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.449450 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.449590 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.450019 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.450126 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.450524 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.450630 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.451058 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.451172 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.451477 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.451577 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.451995 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.452099 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.452516 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-4-iscsi {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.452622 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-4-iscsi {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.453119 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.453231 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.453712 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.453820 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.454168 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.454267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.454699 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.454800 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.455198 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.455303 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.455719 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.455827 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.456219 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.456325 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.457079 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.457215 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.457774 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.457947 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.458276 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.458418 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.458993 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.459157 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.459335 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.459521 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.459848 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.459991 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.460356 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.460492 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.461009 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.461163 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.461406 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.461553 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.461948 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.462137 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.462454 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.462636 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.463111 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-4-iscsi {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.463254 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-4-iscsi {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.463628 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.463777 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.464251 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.464397 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.464661 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.464810 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.465357 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.465499 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.465902 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.466046 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.466414 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.466537 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.466941 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.467075 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.467474 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.467613 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.467988 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.468149 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.469061 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.469242 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.469590 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.469758 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.470146 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.470326 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.470672 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.470807 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.471172 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.471306 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.471682 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.471819 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.472193 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.472325 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.472722 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.472867 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.473225 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.473424 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.473758 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.473905 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.474170 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.474295 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.474682 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.474815 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.475214 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.475338 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.475748 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.475891 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.476279 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.476418 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.476694 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.476828 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.477106 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.477247 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.477668 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.477823 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.478182 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.478330 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.478689 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.478813 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.479196 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.479321 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.479714 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.479830 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.480222 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.480321 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.480725 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.480833 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.481229 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.481336 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.481767 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.481881 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.482274 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.482373 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.482795 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.482892 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.483321 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.483422 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.483852 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.483963 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.484430 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.484588 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.484957 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.485054 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.485641 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.485741 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.486069 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.486186 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.486580 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.486706 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.487143 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.487247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.487665 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.487772 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.488182 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.488378 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.488756 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.489072 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.489236 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.489389 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.490044 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.490203 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.490350 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.490473 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.490807 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.490947 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.491338 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.491470 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.491939 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.492073 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.492375 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.492500 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.492832 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.492975 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.493272 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.498108 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.500445 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.500627 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.500627 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.500929 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.500929 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.501282 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.501282 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.501546 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.501662 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.501807 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.501953 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502109 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502272 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502418 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502522 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502618 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502706 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502820 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.502820 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503050 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503050 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503198 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503283 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503378 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503464 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503549 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503639 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503719 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503719 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503927 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.503927 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504129 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504266 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504392 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504613 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504705 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504785 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.504915 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505056 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505163 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505305 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505305 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505500 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505500 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505745 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505826 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.505919 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.506334 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.506524 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.506864 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.506960 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.507374 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.507477 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.507884 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.507991 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.508408 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.508524 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.508916 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.509026 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.509420 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.509509 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.509980 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.510071 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.510496 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.510613 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.510991 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.511102 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.511510 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.511651 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.512017 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.512116 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.512532 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.512640 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.513035 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.513180 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.513543 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.513675 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.514081 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.514169 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.514590 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.514681 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.515165 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.515277 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.515677 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.515769 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.516183 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.516291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.516690 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.516779 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.517227 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.517326 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.517779 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.517887 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.518299 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.518438 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.518875 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.519014 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.519430 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.519624 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:59.519978 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.520067 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.520654 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.520759 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.521089 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.521190 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.521702 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.521835 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.522192 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.522283 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.522746 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.522851 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.523447 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.523571 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.523801 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.523890 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.524324 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.524413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.525006 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.525156 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.525388 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.525816 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.526190 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.526324 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.526711 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.526835 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.527330 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.527472 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.527774 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.527893 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.528320 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.528451 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.528849 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.528947 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.529372 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.529485 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.529930 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.530025 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.530455 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.530594 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.531552 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.531673 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.532056 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.532170 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.532688 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.532805 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.533138 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.533266 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.533730 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.533831 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.534300 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.534404 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.534824 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.534957 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.535367 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.535467 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.535904 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.536071 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.536421 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.536577 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.536942 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.537089 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.537455 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.537568 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.538045 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.538155 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.538568 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.538668 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.539085 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.539176 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.539616 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.539768 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.540130 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.540218 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.540669 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.540757 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.541192 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.541293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.541735 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.541853 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.542257 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.542368 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.542776 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.542936 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.543400 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.543544 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.543867 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.543954 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.544358 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.544451 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.544892 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.545005 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.545413 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.545503 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.545960 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.546077 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.546490 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.546788 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.547139 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.547319 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.547672 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.547844 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.548197 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.548371 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.548716 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.548891 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.549230 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.549397 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.549775 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.549942 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.550306 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.550470 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.550816 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.550963 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.551359 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.551504 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.551911 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.552051 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.552439 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.552573 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.552993 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.553100 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.553512 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.553657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.554077 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.554244 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.554581 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.554670 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.555098 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.555194 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.555610 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.555709 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.556128 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.556208 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.556649 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.556747 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.557151 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.557228 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.557728 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.557862 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.558246 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.558324 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.558757 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.558940 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.559295 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.559380 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.559854 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.560016 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.560317 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.560405 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.560841 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.560920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.561365 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.561444 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.561910 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.562007 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.562952 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.563064 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.563465 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.563601 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.564082 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.564222 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.564524 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.564666 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.565601 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.565738 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.565738 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.565927 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.566151 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.566251 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.566663 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.566786 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.567193 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.567280 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.567731 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.568059 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.568253 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.568360 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.568762 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.568895 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.569274 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.569375 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.569952 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.570644 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.570740 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.570811 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.570811 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.571024 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.571300 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.571403 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.571803 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.571910 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.572305 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.572402 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.572805 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.572912 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.573313 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.573411 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.573838 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.573928 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.574381 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.574484 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.574894 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.575002 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.575398 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.575486 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.575902 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.576012 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.576406 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.576551 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.576971 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.577085 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.577477 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.577564 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.578146 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.578269 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.578699 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.578815 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.579230 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.579322 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.579763 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.579854 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.580280 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.580380 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.580809 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.580896 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.581331 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.581492 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.581902 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.582468 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.582696 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.583000 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.583235 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.583555 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.584824 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.584824 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.586576 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.586696 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.586823 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.586823 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.587129 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.587237 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.587407 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.587530 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.587933 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.588078 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.588445 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.588551 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.588970 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.589084 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.589486 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.589671 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.590046 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.590324 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.590719 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.590811 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.591263 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.591450 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.591797 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.591943 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.592315 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.592464 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.592827 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.593010 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.596818 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.596979 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.597154 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.597311 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.597311 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.597311 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.597817 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.597999 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.598455 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.598827 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.599868 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.600057 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.600264 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.600574 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.600799 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.601110 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.601316 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.601893 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.602360 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.602517 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.602938 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.603112 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.603467 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.603634 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.603983 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.604146 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.604510 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.604665 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.605026 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.605170 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.605538 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.605668 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.606088 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.606321 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.606761 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.606943 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.607100 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.607294 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.607708 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.607802 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.608166 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.608725 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.608725 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.609046 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.609212 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.609307 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.609710 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.609807 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.610232 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.610332 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.610745 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.611172 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.611261 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.611389 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.611749 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.611919 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.612266 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.612804 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.613357 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.613940 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.614328 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.614532 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.615162 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.615425 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.615788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.615917 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.616307 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.616433 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.616829 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.616959 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.617343 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.617422 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.617914 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.618021 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.618431 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.618512 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.618942 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.619037 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.619973 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.620080 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.620080 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.620226 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.620441 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.620578 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.620990 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.621094 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.621492 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.621593 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.622031 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.622128 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.622686 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.622801 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.623045 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.623583 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.623682 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.624103 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.624210 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.625636 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.625787 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.625787 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.626026 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.626164 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.626270 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.626696 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.626811 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.627190 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.627343 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.627708 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.627859 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.628214 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.628355 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.628725 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.628891 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.629263 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.629411 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.629808 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.629945 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.630322 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.630441 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.630842 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.630969 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.631359 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.631447 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.631873 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.631960 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.632384 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.632517 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.632959 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.633361 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.633569 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.633950 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.634099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.634474 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.635041 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.635643 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.636210 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.636538 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.636818 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.637386 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.637985 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.638528 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.639080 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.639641 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.640183 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.640873 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.641417 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.641995 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.642515 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.642742 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.643037 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.643300 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.643542 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.643845 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.644059 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.644564 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.644901 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.645114 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.645568 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.645812 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.646142 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.646268 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.646687 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.646838 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.647216 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.647353 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.647795 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.647927 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.648339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.648477 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.648918 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.649055 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.649342 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.649493 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.649975 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.650081 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.650385 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.650783 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.651105 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.651245 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.651522 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.651692 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.651840 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.652086 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.652249 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.652490 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.652636 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.652801 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.653043 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.653131 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.653431 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.653533 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.653761 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.654066 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.654163 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.654427 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.654621 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.654755 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.655043 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.655151 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.655365 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.655595 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.655698 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.656452 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.656604 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.657125 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.657265 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.657403 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.657521 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.657677 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.657838 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.658182 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.658393 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.658532 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.658681 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.658873 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.659183 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.659324 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.659752 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.660000 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.660187 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.660327 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.660478 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.660616 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.660756 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.660882 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.661076 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.661300 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.661672 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.661799 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.661985 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.662253 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.662342 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.662566 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.662863 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.662951 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.663168 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.663399 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.663499 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.663799 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.663995 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.664108 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.664227 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.664393 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.664704 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.664828 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.665008 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.665160 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.665312 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.665485 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.665646 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.666048 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.666196 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.666315 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.666404 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.666626 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.666801 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.667339 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.667448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.667529 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.667529 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.667666 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.667818 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.668126 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.668222 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.668428 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.668735 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.668834 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.669058 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.669349 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.669441 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.669685 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.669934 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.670051 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.670304 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.670480 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.670608 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.670914 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.671053 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.671216 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.671596 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.671735 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.671977 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.672240 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.672351 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.672620 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.672801 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.672930 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.673253 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.673346 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.673572 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.673895 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.673986 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.674204 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.674469 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.674558 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.674810 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.675027 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.675118 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.675418 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.675577 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.675719 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.676021 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.676154 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.676442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.676668 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.676755 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.677100 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.677408 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.677543 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.677829 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.677921 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.678187 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.678403 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.678507 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.678838 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.678939 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.679113 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.679424 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.679501 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.679837 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.680062 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.680176 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.680404 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.680608 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.680706 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.681020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.681174 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.681320 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.681728 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.681831 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.681951 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.682281 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.682425 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.682573 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.682878 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.682975 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.683201 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.683425 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.683735 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.683964 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.684054 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.684308 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.684502 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.684644 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.684939 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.685067 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.685237 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.685683 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.685776 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.686012 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.686409 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.686529 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.686613 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.686817 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.686913 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.687276 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.687389 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.687767 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.687907 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.688005 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.688212 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.688463 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.688633 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.689024 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.689131 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.689338 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.689577 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.689687 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.689969 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.690226 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.690359 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.690571 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.690698 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.690895 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.691199 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.691286 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.691630 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.691769 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.691933 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.692265 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.692466 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.692608 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.692901 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.692994 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.693305 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.693448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.693637 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.693962 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.694128 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.694377 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.694594 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.694693 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.694980 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.695166 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.695299 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.695617 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.695768 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.695939 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.696242 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.696420 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.696557 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.696856 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.696960 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.697222 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.697462 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.697563 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.697981 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.698082 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.698300 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.698606 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.698707 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.698928 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.699184 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.699292 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.699552 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.699747 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.699874 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.700330 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.700484 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.700640 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.700836 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.700961 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.701264 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.701375 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.701591 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.701920 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.702009 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.702225 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.702535 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.702698 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.703356 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.703579 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.703673 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.704049 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.704185 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.704283 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.704580 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.704713 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.704889 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.705197 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.705285 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.705501 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.705827 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.705931 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.706150 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.706428 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.706516 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.706768 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.706989 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.707085 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.707390 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.707584 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.707708 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.708109 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.708212 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.708333 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.708642 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.708738 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.708947 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.709330 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.709439 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.709551 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.709842 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.709988 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.710209 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.710382 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.710597 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.710845 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.710942 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.711173 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.711483 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.711587 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.711813 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.712051 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.712148 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.712523 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.712722 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.712822 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.713118 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.713210 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.713447 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.713762 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.713874 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.714197 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.714326 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.714416 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.714703 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.714895 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.714997 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.715297 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.715453 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.715604 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.715906 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.715991 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.716207 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.716507 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.716594 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.716904 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.717091 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.717234 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.717560 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.717724 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.717893 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.718304 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.718446 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.718621 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.718794 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.718930 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.719275 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.719384 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.719580 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.719869 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.719959 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.720209 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.720536 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.720635 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.720847 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.721160 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.721261 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.721475 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.721770 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.721861 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.722114 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.722322 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.722419 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.722742 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.722872 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.723042 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.723358 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.723446 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.723672 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.723991 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.724078 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.724567 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.724681 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.724894 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.725120 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.725210 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.725507 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.725844 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.725956 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.726159 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.726452 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.726593 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.726796 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.727113 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.727216 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.727403 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.727586 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.727712 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.728043 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.728140 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.728515 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.728645 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.728735 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.729009 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.729209 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.729330 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.729741 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.729843 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.729982 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.730294 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.730391 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.730666 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.730961 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.731072 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.731264 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.731470 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.731568 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.731879 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.732054 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.732196 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.732507 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.732603 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.732826 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.733141 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.733304 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.733439 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.733772 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.733936 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.734686 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.734941 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.735049 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.735252 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.735513 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.735616 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.735907 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.736224 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.736311 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.736538 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.736807 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.736903 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.737234 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.737366 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.737745 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.737964 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.738068 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.738390 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.738659 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.738805 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.739098 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.739187 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.739449 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.739635 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.739789 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.740194 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.740281 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.740507 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.740762 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.740865 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.741126 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.741360 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.741449 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.741750 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.741979 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.742070 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.742373 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.742558 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.742678 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.743000 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.743133 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.743310 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.743666 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.743865 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.744239 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.744349 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.744533 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.744932 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.745087 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.745197 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.745396 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.745516 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.745926 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.746086 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.746250 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.746556 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.746758 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.746848 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.747167 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.747341 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.747465 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.747773 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.747870 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.748199 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.748785 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.748925 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.749095 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.749237 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.749415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.749415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.749555 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.749855 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.750178 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.750326 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.750563 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.750700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.750931 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.751206 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.751343 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.751565 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.751784 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.751873 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.752167 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.752352 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.752474 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.752777 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.752903 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.753088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.753394 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.753483 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.753733 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.754039 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.754128 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.754653 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.754767 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.754852 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.755011 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.755102 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.755313 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.755661 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.755731 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.755936 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.756181 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.756308 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.756548 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.756684 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.756858 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.757180 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.757276 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.757601 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.757788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.757928 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.758296 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.758471 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.758685 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.758902 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.759426 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.759532 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.759603 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.759912 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.760016 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.760336 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.760582 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.760674 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.760950 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.761154 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.761250 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.761550 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.761750 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.761911 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.762224 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.762322 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.762537 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.762848 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.762935 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.763158 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.763413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.763518 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.763759 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.763999 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.764090 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.764361 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.764622 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.764720 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.765005 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.765204 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.765883 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.766172 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.766292 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.766482 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.766790 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.766878 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.767108 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.767451 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.767591 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.767832 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.768028 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.768175 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.768540 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.768635 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.768903 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.769151 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.769279 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.769678 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.769793 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.769985 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.770295 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.770384 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.770707 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.770848 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.771050 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.771388 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.771479 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.771843 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.771930 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.772497 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.772592 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.772906 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.773063 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.773220 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.773549 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.773758 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.773878 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.774200 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.774286 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.774523 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.774745 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.774834 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.775146 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.775283 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.775713 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.776042 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.776130 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.776389 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.776639 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.776871 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.777224 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.777427 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.777863 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.778019 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.778200 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.778409 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.778508 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.778809 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.778986 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.779126 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.779437 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.779526 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.779851 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.780153 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.780266 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.780460 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.780697 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.780805 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.781183 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.781353 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.781569 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.781906 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.782014 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.782216 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.782495 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.782585 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.782815 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.783056 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.783146 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.783408 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.783609 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.783697 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.783996 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.784173 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.784306 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.784608 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.784735 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.784921 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.785222 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.785310 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.785529 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.785851 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.785943 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.786191 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.786429 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.786518 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.786826 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.786993 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.787142 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.787575 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.787688 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.788154 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.788253 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.788488 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.788780 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.789115 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.789205 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.789522 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.789769 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.790041 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.790326 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.790441 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.790655 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.790807 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.790897 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.791120 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.791406 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.791556 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.791776 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.791982 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.792078 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.792529 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.792623 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.792879 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.793150 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.793281 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.793480 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.793757 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.793869 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.794134 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.794300 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.794452 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.794766 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.794852 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.795095 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.795406 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.795493 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.795776 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.796007 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.796096 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.796324 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.797188 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.797294 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.797595 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.797740 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.797901 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.798213 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.798350 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.798531 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.798848 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.798933 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.799199 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.799542 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.799692 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.799817 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.800060 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.800252 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.800616 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.800719 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.801111 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.801250 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.801431 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.801851 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.801945 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.802282 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.802434 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.802611 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.802934 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.803172 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.803321 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.803481 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 20:04:59.803654 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.804141 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.804701 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.805258 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.806000 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.806437 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.807022 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.807601 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.808185 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.808755 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.809355 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.810431 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.810588 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.811318 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.811666 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.812487 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.813351 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.814209 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.814773 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.815250 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.815794 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.816348 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.816900 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.817506 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.818109 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.818655 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.819213 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.819858 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.820399 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.821048 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.821637 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.822209 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.822794 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.823377 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.824389 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.825003 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.825569 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.826186 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.826761 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.827353 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.828442 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.829003 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.829557 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.830170 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.830764 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.831352 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.831926 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.832479 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.833044 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.833648 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.834202 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.834785 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.835336 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.835902 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.836435 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.837004 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.837571 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.838288 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.838859 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.839442 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.840021 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.840563 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.841157 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.841765 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.842354 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.842932 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.843591 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.844238 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.844831 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.845413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.846067 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.846646 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.847194 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.847773 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.848340 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.848918 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.849486 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.850088 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.850766 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.851306 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.852359 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.852970 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.853544 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.854196 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.854781 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.855328 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.855870 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.856431 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.857036 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.857660 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.858244 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.858820 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.859912 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.860456 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.861038 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.861588 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.862193 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.862779 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.863365 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.863941 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.864517 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.865100 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.865716 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.866321 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.866973 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.867573 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.868177 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.868775 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.869358 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.869967 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.870546 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.871113 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.871688 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.872267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.872875 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.873483 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.874085 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.875447 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.876042 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.876631 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.877289 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.877841 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.878483 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.879147 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.879636 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.880259 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.880815 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.881463 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.882110 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.882721 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.883300 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.883861 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.884435 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.884990 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.885564 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.886191 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.886777 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.887499 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.887885 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.888471 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.889038 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.889601 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.890195 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.891275 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.891892 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.892433 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.893001 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.893556 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.894188 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.894742 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.895314 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.895909 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.896457 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.897052 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.897752 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.898136 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.898719 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.899459 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.899968 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.900802 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.901394 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.902037 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.902618 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.903201 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.903767 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.904383 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.904941 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.905518 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.906265 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.906827 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.907423 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.907951 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.908565 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.909137 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.909752 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.910409 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.910987 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.911579 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.912170 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.912758 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.913355 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.913965 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.914551 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.915173 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.915752 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.916320 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.916883 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.917426 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.918015 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.918598 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.919211 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.919732 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.920324 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.920898 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.922061 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.922690 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.923270 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.923889 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.924503 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.925134 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.925749 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.926394 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.926995 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.927583 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.928176 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.928734 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:59.929186 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 20:04:59.975577 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO dbcounter [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Registered counter for database nova_api Sep 06 20:05:00.003124 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_db.sqlalchemy.engines [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.014931 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writer thread running {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:00.081569 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.context [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),089655f8-2bf0-4b56-ad47-918579e24a3f(cell1) {{(pid=105837) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 20:05:00.086363 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:05:00.086855 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:05:00.088772 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:05:00.089645 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:05:00.090113 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:05:00.092281 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:05:00.095209 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO dbcounter [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Registered counter for database nova_cell0 Sep 06 20:05:00.100369 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO dbcounter [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Registered counter for database nova_cell1 Sep 06 20:05:00.108947 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_db.sqlalchemy.engines [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.112204 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_db.sqlalchemy.engines [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.118828 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writer thread running {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:00.122518 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writer thread running {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:00.185543 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO dbcounter [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Registered counter for database nova_api Sep 06 20:05:00.221169 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_db.sqlalchemy.engines [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.233036 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writer thread running {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:00.280418 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO dbcounter [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Registered counter for database nova_cell0 Sep 06 20:05:00.288157 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_db.sqlalchemy.engines [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.293838 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writer thread running {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:00.342147 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.context [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),089655f8-2bf0-4b56-ad47-918579e24a3f(cell1) {{(pid=105838) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 20:05:00.350588 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_concurrency.lockutils [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:05:00.351446 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_concurrency.lockutils [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:05:00.354863 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_concurrency.lockutils [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:05:00.356238 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_concurrency.lockutils [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:05:00.357074 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_concurrency.lockutils [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:05:00.361236 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_concurrency.lockutils [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=105838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:05:00.365262 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO dbcounter [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Registered counter for database nova_cell0 Sep 06 20:05:00.373359 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO dbcounter [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Registered counter for database nova_cell1 Sep 06 20:05:00.389606 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_db.sqlalchemy.engines [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.395024 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_db.sqlalchemy.engines [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.405033 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writer thread running {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:00.409731 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writer thread running {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:00.659145 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: WARNING keystonemiddleware.auth_token [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:05:00.666967 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: WARNING keystonemiddleware.auth_token [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:05:00.689224 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO dbcounter [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Registered counter for database nova_cell0 Sep 06 20:05:00.703234 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG oslo_db.sqlalchemy.engines [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:00.711632 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writer thread running {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:01.019480 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: WARNING keystonemiddleware.auth_token [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:05:01.026354 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: WARNING keystonemiddleware.auth_token [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:05:01.033200 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563f82f2d9c0 pid: 105837 (default app) Sep 06 20:05:01.035597 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:05:01.036835 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001997 Sep 06 20:05:01.037573 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Sep 6 20:05:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:05:01.321691 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: WARNING keystonemiddleware.auth_token [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:05:01.336648 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: WARNING keystonemiddleware.auth_token [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:05:01.969923 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: WARNING keystonemiddleware.auth_token [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:05:01.982440 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: WARNING keystonemiddleware.auth_token [None req-ca787ca1-aab0-4aeb-92dd-56c186d3df76 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:05:01.995396 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563f82f2d9c0 pid: 105838 (default app) Sep 06 20:06:44.813837 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:06:44.815541 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002276 Sep 06 20:06:44.816143 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:06:44.829869 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writing DB stats nova_api:SELECT=3 {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.831250 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writing DB stats nova_cell0:SELECT=3 {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.832214 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writing DB stats nova_cell1:SELECT=3 {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.833079 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writing DB stats nova_cell0:SELECT=3 {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.007408 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-ccf653c9-f2e7-4d5c-9b7c-624bd33c10f9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:06:46.064031 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-ccf653c9-f2e7-4d5c-9b7c-624bd33c10f9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.239598 Sep 06 20:06:46.064938 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 20:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:06:49.363801 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:06:49.365372 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-7ef4c220-235e-4250-bb15-f0edcdcc2932 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Sep 06 20:06:49.366284 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:06:50.135916 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-78440063-1960-418b-b15f-edde904a9e39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "swap": 0, "vcpus": 1, "name": "cirros256", "id": "c1"}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:06:50.196748 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-78440063-1960-418b-b15f-edde904a9e39 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.821730 Sep 06 20:06:50.197342 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:06:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:06:50.217876 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_api:SELECT=3 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.218719 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_cell0:SELECT=3 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.219919 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_cell1:SELECT=3 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.220785 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.433903 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-a646e4c0-53f6-4bb2-a633-3ef0da6265e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:06:50.518089 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-a646e4c0-53f6-4bb2-a633-3ef0da6265e5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306908 Sep 06 20:06:50.518700 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 20:06:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:06:53.909033 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-78440063-1960-418b-b15f-edde904a9e39 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:06:53.910674 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-78440063-1960-418b-b15f-edde904a9e39 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Sep 06 20:06:53.911603 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:06:55.003029 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-7b8af356-510b-4ea6-867f-d33f70c68593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:06:55.057832 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-7b8af356-510b-4ea6-867f-d33f70c68593 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.138766 Sep 06 20:06:55.059124 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:06:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:06:55.079437 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-050576de-a077-4a25-a887-8c63e40ea306 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:06:55.140030 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-050576de-a077-4a25-a887-8c63e40ea306 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067318 Sep 06 20:06:55.141957 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 20:06:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:58.145097 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-7b8af356-510b-4ea6-867f-d33f70c68593 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:06:58.146074 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-7b8af356-510b-4ea6-867f-d33f70c68593 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Sep 06 20:06:58.146542 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:06:58.682970 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-4bd1e94c-f55f-4420-af6c-5c75ff4e8613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "id": "d2", "vcpus": 1, "name": "ds1G", "disk": 10}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:06:58.709394 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-4bd1e94c-f55f-4420-af6c-5c75ff4e8613 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.554685 Sep 06 20:06:58.710218 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:06:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:06:58.724397 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-9becc068-e310-4e85-9024-805a2e7b4df2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:06:58.757974 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-9becc068-e310-4e85-9024-805a2e7b4df2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037210 Sep 06 20:06:58.758717 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 20:06:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:07:01.747510 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-4bd1e94c-f55f-4420-af6c-5c75ff4e8613 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:01.748732 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-4bd1e94c-f55f-4420-af6c-5c75ff4e8613 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001760 Sep 06 20:07:01.749249 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:07:02.482999 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-3e6f81a3-4ab2-4254-8c63-60faddca7477 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:02.508109 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-3e6f81a3-4ab2-4254-8c63-60faddca7477 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.747569 Sep 06 20:07:02.508699 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:07:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:02.530829 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-8c2a07b7-8cca-46d9-93fb-bca0dfc89d64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:02.567744 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-8c2a07b7-8cca-46d9-93fb-bca0dfc89d64 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044199 Sep 06 20:07:02.569269 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 20:07:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:07:06.321976 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-3e6f81a3-4ab2-4254-8c63-60faddca7477 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:06.325117 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-3e6f81a3-4ab2-4254-8c63-60faddca7477 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003938 Sep 06 20:07:06.328083 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:06.975073 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-0d5fe3e5-8a28-4573-8993-f037e597f495 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "d4", "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:07.010571 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-0d5fe3e5-8a28-4573-8993-f037e597f495 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.675068 Sep 06 20:07:07.012066 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:07:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:07.033913 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-fa69dab9-a57c-48fd-9c5c-eb69e1e1abf8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:07.112195 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-fa69dab9-a57c-48fd-9c5c-eb69e1e1abf8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084085 Sep 06 20:07:07.114329 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 6 20:07:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:07:10.727887 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-0d5fe3e5-8a28-4573-8993-f037e597f495 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:10.730245 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-0d5fe3e5-8a28-4573-8993-f037e597f495 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002471 Sep 06 20:07:10.731027 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:11.459675 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-9194b089-e1a0-48f8-9994-5cf5f5d976b7 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:11.488745 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-9194b089-e1a0-48f8-9994-5cf5f5d976b7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.748322 Sep 06 20:07:11.489380 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 20:07:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:07:14.557043 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-0d5fe3e5-8a28-4573-8993-f037e597f495 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:14.559503 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-0d5fe3e5-8a28-4573-8993-f037e597f495 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002753 Sep 06 20:07:14.560713 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:07:15.152504 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-d9dfe039-6ec9-40c7-af3f-830e399b984c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:15.186406 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-d9dfe039-6ec9-40c7-af3f-830e399b984c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.616791 Sep 06 20:07:15.187276 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:07:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:15.206224 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-ba89262a-efc8-4821-9aaf-69c8764eadc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:15.211943 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:15.245655 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-ba89262a-efc8-4821-9aaf-69c8764eadc0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043669 Sep 06 20:07:15.247084 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 20:07:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:07:18.508711 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-d9dfe039-6ec9-40c7-af3f-830e399b984c admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:18.510521 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-d9dfe039-6ec9-40c7-af3f-830e399b984c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002404 Sep 06 20:07:18.511003 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:07:19.098396 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-5b64f967-b95d-41a6-96fb-1e98bd6d0ed4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:19.122146 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-5b64f967-b95d-41a6-96fb-1e98bd6d0ed4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.603681 Sep 06 20:07:19.123182 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:07:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:19.136779 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-034d1f87-547d-43a6-ab98-8d16a615f401 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:19.168161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-034d1f87-547d-43a6-ab98-8d16a615f401 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035339 Sep 06 20:07:19.169158 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 20:07:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:07:22.211590 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-5b64f967-b95d-41a6-96fb-1e98bd6d0ed4 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:22.215240 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-5b64f967-b95d-41a6-96fb-1e98bd6d0ed4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 06 20:07:22.218156 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:23.098946 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-9e1bfdf6-b444-401a-bc70-6291621a3f02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "id": "3", "swap": 0, "disk": 40}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:23.115392 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:23.146386 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-9e1bfdf6-b444-401a-bc70-6291621a3f02 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.924933 Sep 06 20:07:23.147779 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:07:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:23.168655 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-73357c66-bdc1-4fee-8bb3-38946eb754e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:23.223329 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-73357c66-bdc1-4fee-8bb3-38946eb754e0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060786 Sep 06 20:07:23.225547 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 20:07:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:07:26.922881 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-9e1bfdf6-b444-401a-bc70-6291621a3f02 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:26.924625 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-9e1bfdf6-b444-401a-bc70-6291621a3f02 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002471 Sep 06 20:07:26.925366 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:27.530362 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-b14bfa55-642e-4393-b623-90f7329bc18d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:27.564772 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-b14bfa55-642e-4393-b623-90f7329bc18d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.626623 Sep 06 20:07:27.574380 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:07:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:27.583566 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-ad63987c-841d-4bef-8bd0-75852aecd287 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:27.628113 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-ad63987c-841d-4bef-8bd0-75852aecd287 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049055 Sep 06 20:07:27.629022 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 20:07:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:07:30.878129 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-b14bfa55-642e-4393-b623-90f7329bc18d admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:30.880219 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-b14bfa55-642e-4393-b623-90f7329bc18d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003343 Sep 06 20:07:30.880973 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:07:31.616956 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-fbc6d8fa-77b2-4961-ab9e-276d380237c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:31.645078 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-fbc6d8fa-77b2-4961-ab9e-276d380237c2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.752464 Sep 06 20:07:31.645995 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 6 20:07:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:31.660495 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-fef7e32f-a2a5-4a01-8fe8-52543209aabe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:07:31.710687 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-fef7e32f-a2a5-4a01-8fe8-52543209aabe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054662 Sep 06 20:07:31.711819 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 6 20:07:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:07:51.782059 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-fbc6d8fa-77b2-4961-ab9e-276d380237c2 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:51.783508 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-fbc6d8fa-77b2-4961-ab9e-276d380237c2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001873 Sep 06 20:07:51.784256 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:51.796030 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:52.399363 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-62ae921f-f8e3-40a8-9080-e143be229651 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:52.420320 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-62ae921f-f8e3-40a8-9080-e143be229651 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.629030 Sep 06 20:07:52.421186 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 20:07:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:07:53.972247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-fbc6d8fa-77b2-4961-ab9e-276d380237c2 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:53.973319 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-fbc6d8fa-77b2-4961-ab9e-276d380237c2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Sep 06 20:07:53.973769 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:54.749789 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-4f4b5426-12bb-4c7b-ab7d-b4042fb05e18 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:54.758258 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.wsgi [None req-4f4b5426-12bb-4c7b-ab7d-b4042fb05e18 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-4f4b5426-12bb-4c7b-ab7d-b4042fb05e18 admin admin] Request method failure captured: Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Accept: application/json Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Accept-Encoding: gzip, deflate Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Connection: keep-alive Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Content-Length: 0 Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Host: 10.222.0.20 Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Openstack-Api-Version: compute 2.92 Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Openstack-System-Scope: None Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: User-Agent: python-novaclient Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Auth-Token: gAAAAABjF6iZS71sZnLF3xGnJ3wRoBQlxP8VeHA8dX2fb335lTa3phBBEQrXWtbcU3GhziBWjXEL3waq6Vg8CqWLDpqafnxfkisL9mZPp3rivGvJHpSkkM_zqohpL1ygKnTCbWzvU38Yk5IMZXWqPabaKb4G0vF-sz42KcvV7rOijJQ5l_9XiLw Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Domain-Id: None Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Domain-Name: None Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Identity-Status: Confirmed Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Is-Admin-Project: True Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Domain-Id: default Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Domain-Name: Default Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Name: admin Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Role: member,admin,reader Sep 06 20:07:54.763339 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Roles: member,admin,reader Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant: admin Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant-Name: admin Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User: admin Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Domain-Id: default Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Domain-Name: Default Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Id: 1e7095a0137b45c984179dcf25de9362 Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Name: admin Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: method: > Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: exception: Flavor 42 could not be found. Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: action_args: {'id': '42'} Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:07:54.765293 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:54.766448 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.767846 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-4f4b5426-12bb-4c7b-ab7d-b4042fb05e18 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:07:54.769182 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-4f4b5426-12bb-4c7b-ab7d-b4042fb05e18 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.642740 Sep 06 20:07:54.769182 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 20:07:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 645 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 20:07:54.779261 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-0fd9acd0-5c71-4746-b215-ac9876a2d009 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:54.783810 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:54.806774 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-0fd9acd0-5c71-4746-b215-ac9876a2d009 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.032950 Sep 06 20:07:54.807375 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 20:07:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:07:54.825460 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-5cd790e3-5fed-455b-802d-1e2bde2f5247 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:54.865235 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-5cd790e3-5fed-455b-802d-1e2bde2f5247 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.046757 Sep 06 20:07:54.865881 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 20:07:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:07:54.876279 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-12344409-8bd6-4dea-aac3-d4c10c347087 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:54.883053 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.wsgi [None req-12344409-8bd6-4dea-aac3-d4c10c347087 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-12344409-8bd6-4dea-aac3-d4c10c347087 admin admin] Request method failure captured: Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Accept: application/json Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Accept-Encoding: gzip, deflate Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Connection: keep-alive Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Content-Length: 0 Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Host: 10.222.0.20 Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Openstack-Api-Version: compute 2.92 Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Openstack-System-Scope: None Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: User-Agent: python-novaclient Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Auth-Token: gAAAAABjF6iZS71sZnLF3xGnJ3wRoBQlxP8VeHA8dX2fb335lTa3phBBEQrXWtbcU3GhziBWjXEL3waq6Vg8CqWLDpqafnxfkisL9mZPp3rivGvJHpSkkM_zqohpL1ygKnTCbWzvU38Yk5IMZXWqPabaKb4G0vF-sz42KcvV7rOijJQ5l_9XiLw Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Domain-Id: None Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Domain-Name: None Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Identity-Status: Confirmed Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Is-Admin-Project: True Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Domain-Id: default Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Domain-Name: Default Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Name: admin Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Role: member,admin,reader Sep 06 20:07:54.886589 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Roles: member,admin,reader Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant: admin Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant-Name: admin Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User: admin Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Domain-Id: default Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Domain-Name: Default Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Id: 1e7095a0137b45c984179dcf25de9362 Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Name: admin Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: method: > Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: exception: Flavor 42 could not be found. Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: action_args: {'id': '42'} Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:07:54.890415 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:54.893020 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:54.896088 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-12344409-8bd6-4dea-aac3-d4c10c347087 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:07:54.898435 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-12344409-8bd6-4dea-aac3-d4c10c347087 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016202 Sep 06 20:07:54.898435 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 20:07:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 20:07:56.321854 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-5cd790e3-5fed-455b-802d-1e2bde2f5247 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:56.323379 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-5cd790e3-5fed-455b-802d-1e2bde2f5247 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Sep 06 20:07:56.323904 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:57.042997 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-e0653d9a-d242-432b-bdad-0bc9c6e78548 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:57.053800 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.wsgi [None req-e0653d9a-d242-432b-bdad-0bc9c6e78548 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-e0653d9a-d242-432b-bdad-0bc9c6e78548 admin admin] Request method failure captured: Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Accept: application/json Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Accept-Encoding: gzip, deflate Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Connection: keep-alive Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Content-Length: 0 Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Host: 10.222.0.20 Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Openstack-Api-Version: compute 2.92 Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Openstack-System-Scope: None Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: User-Agent: python-novaclient Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Auth-Token: gAAAAABjF6ic8sXkfpkOdTVNhaglLvYCT3pngaX5NZabTEymFvs95QO0HN7s3mHHCGNAd2Kdun3u63f3qdyd-dEtkPgTrc_LZnfRloIisrDgTGBCkNzmdYQlluZHD0v21UTlB3FHVc0vlu2cthjL-wb4Z5XfNTA6qvYaqgAkIqyK5Rr2MQPEVrA Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Domain-Id: None Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Domain-Name: None Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Identity-Status: Confirmed Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Is-Admin-Project: True Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Domain-Id: default Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Domain-Name: Default Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Name: admin Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Role: member,admin,reader Sep 06 20:07:57.055476 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Roles: member,admin,reader Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant: admin Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant-Name: admin Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User: admin Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Domain-Id: default Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Domain-Name: Default Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Id: 1e7095a0137b45c984179dcf25de9362 Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Name: admin Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: method: > Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: exception: Flavor 84 could not be found. Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: action_args: {'id': '84'} Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:07:57.057657 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:57.060038 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.062247 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-e0653d9a-d242-432b-bdad-0bc9c6e78548 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:07:57.064596 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-e0653d9a-d242-432b-bdad-0bc9c6e78548 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.585068 Sep 06 20:07:57.064596 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 20:07:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 587 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 20:07:57.076006 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-24f10b48-1d6e-4794-ad6f-90aa863912a2 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:57.109579 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-24f10b48-1d6e-4794-ad6f-90aa863912a2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.040263 Sep 06 20:07:57.110643 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 20:07:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:07:57.128286 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-2d2da65f-eb80-4bf1-ae32-32f07d6b28ab admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:57.158890 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-2d2da65f-eb80-4bf1-ae32-32f07d6b28ab admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.037425 Sep 06 20:07:57.159931 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 20:07:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:07:57.170768 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-27632246-22f1-4c6b-b926-29c31bea6fed admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:57.176784 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.wsgi [None req-27632246-22f1-4c6b-b926-29c31bea6fed admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-27632246-22f1-4c6b-b926-29c31bea6fed admin admin] Request method failure captured: Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Accept: application/json Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Accept-Encoding: gzip, deflate Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Connection: keep-alive Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Content-Length: 0 Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Host: 10.222.0.20 Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Openstack-Api-Version: compute 2.92 Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Openstack-System-Scope: None Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: User-Agent: python-novaclient Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Auth-Token: gAAAAABjF6ic8sXkfpkOdTVNhaglLvYCT3pngaX5NZabTEymFvs95QO0HN7s3mHHCGNAd2Kdun3u63f3qdyd-dEtkPgTrc_LZnfRloIisrDgTGBCkNzmdYQlluZHD0v21UTlB3FHVc0vlu2cthjL-wb4Z5XfNTA6qvYaqgAkIqyK5Rr2MQPEVrA Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Domain-Id: None Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Domain-Name: None Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Identity-Status: Confirmed Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Is-Admin-Project: True Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Domain-Id: default Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Domain-Name: Default Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Name: admin Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Role: member,admin,reader Sep 06 20:07:57.178413 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Roles: member,admin,reader Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant: admin Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant-Name: admin Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User: admin Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Domain-Id: default Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Domain-Name: Default Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Id: 1e7095a0137b45c984179dcf25de9362 Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Name: admin Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: method: > Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: exception: Flavor 84 could not be found. Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: action_args: {'id': '84'} Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:07:57.179920 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:57.180702 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:57.181788 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-27632246-22f1-4c6b-b926-29c31bea6fed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:07:57.182794 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-27632246-22f1-4c6b-b926-29c31bea6fed admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013376 Sep 06 20:07:57.182794 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 6 20:07:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 20:07:58.675129 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-2d2da65f-eb80-4bf1-ae32-32f07d6b28ab admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:58.676797 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-2d2da65f-eb80-4bf1-ae32-32f07d6b28ab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002455 Sep 06 20:07:58.677413 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:07:59.466961 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-cf1b7ad6-4630-4bf4-a2ae-24ee66906bd1 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:59.473484 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.wsgi [None req-cf1b7ad6-4630-4bf4-a2ae-24ee66906bd1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-cf1b7ad6-4630-4bf4-a2ae-24ee66906bd1 admin admin] Request method failure captured: Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Accept: application/json Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Accept-Encoding: gzip, deflate Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Connection: keep-alive Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Content-Length: 0 Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Host: 10.222.0.20 Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Openstack-Api-Version: compute 2.92 Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Openstack-System-Scope: None Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: User-Agent: python-novaclient Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Auth-Token: gAAAAABjF6ieeGY0lT3_M_SDegOt0msJz8OU_YzX1LGY7-ymNEMlUwSze2zkMFAL9hPCCfqpYOCU7uEF-0LdxxKfMhheVyaFVDkr_OOwsSQ8I2x2owR3Qsh7PgkcZ_9QtEfHo435piDFxdih4pEIY3oimxh37M7HxMalLY9tq53relqSPlXs6sY Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Domain-Id: None Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Domain-Name: None Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Identity-Status: Confirmed Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Is-Admin-Project: True Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Domain-Id: default Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Domain-Name: Default Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Project-Name: admin Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Role: member,admin,reader Sep 06 20:07:59.475099 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Roles: member,admin,reader Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant: admin Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-Tenant-Name: admin Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User: admin Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Domain-Id: default Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Domain-Name: Default Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Id: 1e7095a0137b45c984179dcf25de9362 Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: X-User-Name: admin Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: method: > Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: exception: Flavor 451 could not be found. Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: action_args: {'id': '451'} Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:07:59.477700 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:59.479291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.482267 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-cf1b7ad6-4630-4bf4-a2ae-24ee66906bd1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:07:59.484291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-cf1b7ad6-4630-4bf4-a2ae-24ee66906bd1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.539211 Sep 06 20:07:59.484291 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 20:07:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 20:07:59.493858 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-e35bde3e-f798-44a8-998e-e3859131e400 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:59.522907 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-e35bde3e-f798-44a8-998e-e3859131e400 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.035276 Sep 06 20:07:59.524015 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 20:07:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:07:59.534976 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:59.552106 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020891 Sep 06 20:07:59.552589 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 6 20:07:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:07:59.563337 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-9d5cf15a-db7b-4a58-9380-396300ec4dce admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:07:59.569764 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.wsgi [None req-9d5cf15a-db7b-4a58-9380-396300ec4dce admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-9d5cf15a-db7b-4a58-9380-396300ec4dce admin admin] Request method failure captured: Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Accept: application/json Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Accept-Encoding: gzip, deflate Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Connection: keep-alive Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Content-Length: 0 Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Host: 10.222.0.20 Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Openstack-Api-Version: compute 2.92 Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Openstack-System-Scope: None Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: User-Agent: python-novaclient Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Auth-Token: gAAAAABjF6ieeGY0lT3_M_SDegOt0msJz8OU_YzX1LGY7-ymNEMlUwSze2zkMFAL9hPCCfqpYOCU7uEF-0LdxxKfMhheVyaFVDkr_OOwsSQ8I2x2owR3Qsh7PgkcZ_9QtEfHo435piDFxdih4pEIY3oimxh37M7HxMalLY9tq53relqSPlXs6sY Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Domain-Id: None Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Domain-Name: None Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Identity-Status: Confirmed Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Is-Admin-Project: True Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Domain-Id: default Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Domain-Name: Default Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Project-Name: admin Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Role: member,admin,reader Sep 06 20:07:59.571327 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Roles: member,admin,reader Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a630b7748ecd4893b8db1b6c1dc4efe9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant: admin Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant-Id: a630b7748ecd4893b8db1b6c1dc4efe9 Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-Tenant-Name: admin Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User: admin Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Domain-Id: default Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Domain-Name: Default Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Id: 1e7095a0137b45c984179dcf25de9362 Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: X-User-Name: admin Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: method: > Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: exception: Flavor 451 could not be found. Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: action_args: {'id': '451'} Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:07:59.573442 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:59.575161 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: ERROR nova.api.openstack.wsgi Sep 06 20:07:59.576243 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-9d5cf15a-db7b-4a58-9380-396300ec4dce admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:07:59.577516 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-9d5cf15a-db7b-4a58-9380-396300ec4dce admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013742 Sep 06 20:07:59.577516 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 20:07:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 20:08:00.909377 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:08:00.910436 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Sep 06 20:08:00.910965 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:08:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:08:01.690139 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-31fe3843-b2f3-454a-986c-d30d83523531 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:08:01.713470 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-31fe3843-b2f3-454a-986c-d30d83523531 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.551647 Sep 06 20:08:01.714128 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 20:08:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:03.136974 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:08:03.138752 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002382 Sep 06 20:08:03.139239 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:08:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:08:03.830756 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-01ff2bf1-cf10-4a8e-82f4-6807d3e79116 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:08:03.853977 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-01ff2bf1-cf10-4a8e-82f4-6807d3e79116 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.567382 Sep 06 20:08:03.854541 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 20:08:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:05.282186 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:08:05.283232 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 06 20:08:05.283637 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:08:06.040354 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-f7526d91-cb86-43d8-b653-0e88ae596bda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:08:06.063067 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-f7526d91-cb86-43d8-b653-0e88ae596bda admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.636352 Sep 06 20:08:06.063632 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 20:08:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:07.503597 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:08:07.504619 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 06 20:08:07.505024 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:08:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:08:08.228508 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-54132561-ba3f-4196-a61e-c0fd793135fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:08:08.252340 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-54132561-ba3f-4196-a61e-c0fd793135fa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.603831 Sep 06 20:08:08.252921 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 6 20:08:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:09.594872 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:08:09.596252 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Sep 06 20:08:09.596823 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:08:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:08:10.231640 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-c7b9ebc0-550f-4578-9cfa-217fdd90417a admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:08:10.254007 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-c7b9ebc0-550f-4578-9cfa-217fdd90417a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.518712 Sep 06 20:08:10.254722 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Sep 6 20:08:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:09:17.594745 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:09:17.595767 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-495223a8-b493-4ff8-b260-2f5173940fc9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Sep 06 20:09:17.596179 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 6 20:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:09:17.605930 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:09:18.274932 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-754393c6-16c1-4cec-86f6-e3de74f68d96 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:09:18.300129 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-754393c6-16c1-4cec-86f6-e3de74f68d96 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.695864 Sep 06 20:09:18.300710 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 6 20:09:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:09:18.323518 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG dbcounter [-] [105838] Writing DB stats nova_api:SELECT=14 {{(pid=105838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:09:18.328991 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-0e37b5e6-c6f2-4cb8-88ff-243d10db4fda admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:09:18.338531 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-0e37b5e6-c6f2-4cb8-88ff-243d10db4fda admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016780 Sep 06 20:09:18.339107 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Sep 6 20:09:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:09:18.360254 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-bbd85d63-3d11-42ef-841c-4fba93a08e26 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:09:18.380647 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-bbd85d63-3d11-42ef-841c-4fba93a08e26 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.026355 Sep 06 20:09:18.381676 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Sep 6 20:09:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:09:18.400373 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:09:18.409300 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012774 Sep 06 20:09:18.410021 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Sep 6 20:09:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:09:18.433096 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-786df0a4-a4a7-486f-bfd4-5bbeda1b72cc admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:09:18.448577 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-786df0a4-a4a7-486f-bfd4-5bbeda1b72cc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.022744 Sep 06 20:09:18.449643 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Sep 6 20:09:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:12:44.398001 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:12:44.399776 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Sep 06 20:12:44.400287 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:12:44.585142 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_api:SELECT=6 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:12:44.765750 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:12:44.769497 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:12:44.770039 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:12:44.770501 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:12:44.771242 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:12:44.771709 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:12:44.772135 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:12:44.810648 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-fec1a156-0a6c-408d-ad75-4539a1b26dc1 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.227049 Sep 06 20:12:44.811388 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 20:12:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:12:46.145823 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:12:46.147157 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Sep 06 20:12:46.147697 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:12:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:12:46.358519 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:12:46.362213 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:12:46.362698 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:12:46.363130 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:12:46.363859 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:12:46.364348 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:12:46.364759 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:12:46.387943 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-64835889-fdd5-429b-9dfa-349f9a7ac08a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.089063 Sep 06 20:12:46.388536 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 20:12:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:12:58.232959 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:12:58.234405 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001913 Sep 06 20:12:58.235087 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:12:58.390605 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_cell0:SELECT=4 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:12:58.391383 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_cell1:SELECT=4 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:12:58.392013 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG dbcounter [-] [105837] Writing DB stats nova_api:SELECT=8 {{(pid=105837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:12:58.450936 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:12:58.454998 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:12:58.455641 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:12:58.456773 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:12:58.457567 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:12:58.458289 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:12:58.458762 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:12:58.490203 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-e4243103-b7bb-4b99-95a6-4a0fb598c444 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.104615 Sep 06 20:12:58.490951 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 20:12:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:12:59.813037 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: DEBUG nova.api.openstack.wsgi [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] Calling method '>' {{(pid=105838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:12:59.815694 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: INFO nova.api.openstack.requestlog [None req-6dde7a67-3b55-42af-9616-48ec9b409f38 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002910 Sep 06 20:12:59.816059 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: [pid: 105838|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 6 20:12:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:13:00.027640 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG nova.api.openstack.wsgi [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] Calling method '>' {{(pid=105837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:13:00.031353 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:13:00.031815 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:13:00.032257 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:13:00.033089 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:13:00.034075 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:13:00.034556 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: DEBUG oslo_concurrency.lockutils [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:13:00.059923 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: INFO nova.api.openstack.requestlog [None req-d6e84040-7dec-4db2-a9cc-39a607e4e93e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.098137 Sep 06 20:13:00.060550 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: [pid: 105837|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 6 20:12:59 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:14:00.458236 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: Tue Sep 6 20:14:00 2022 - graceful shutdown triggered... Sep 06 20:14:00.459227 dv-cinder-847732-4-iscsi devstack@n-api.service[105837]: Gracefully killing worker 1 (pid: 105837)... Sep 06 20:14:00.458781 dv-cinder-847732-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 20:14:00.460598 dv-cinder-847732-4-iscsi devstack@n-api.service[105838]: Gracefully killing worker 2 (pid: 105838)... Sep 06 20:14:01.459409 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: worker 1 buried after 1 seconds Sep 06 20:14:01.459409 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: worker 2 buried after 1 seconds Sep 06 20:14:01.459409 dv-cinder-847732-4-iscsi devstack@n-api.service[105836]: goodbye to uWSGI. Sep 06 20:14:01.461056 dv-cinder-847732-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 20:14:01.461885 dv-cinder-847732-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 20:14:01.465634 dv-cinder-847732-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 20:14:01.483091 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 20:14:01.486839 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 20:14:01 2022] *** Sep 06 20:14:01.486839 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 20:14:01.486839 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: nodename: dv-cinder-847732-4-iscsi Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: machine: x86_64 Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: clock source: unix Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: pcre jit disabled Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: detected number of CPU cores: 4 Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: current working directory: / Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: detected binary path: /usr/bin/uwsgi-core Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: your processes number limit is 47680 Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: your memory page size is 4096 bytes Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: detected max file descriptor number: 2048 Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: lock engine: pthread robust mutexes Sep 06 20:14:01.487344 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: thunder lock: enabled Sep 06 20:14:01.488179 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 20:14:01.488179 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 20:14:01.562480 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: Python main interpreter initialized at 0x55e4806cb9c0 Sep 06 20:14:01.562480 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: python threads support enabled Sep 06 20:14:01.562480 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: your server socket listen backlog is limited to 100 connections Sep 06 20:14:01.562480 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: your mercy for graceful operations on workers is 90 seconds Sep 06 20:14:01.563023 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 20:14:01.563230 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: *** Operational MODE: preforking *** Sep 06 20:14:01.563760 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: *** uWSGI is running in multiple interpreter mode *** Sep 06 20:14:01.563760 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: spawned uWSGI master process (pid: 120934) Sep 06 20:14:01.564019 dv-cinder-847732-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 20:14:01.565839 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: spawned uWSGI worker 1 (pid: 120951, cores: 1) Sep 06 20:14:01.565839 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: spawned uWSGI worker 2 (pid: 120952, cores: 1) Sep 06 20:14:01.565839 dv-cinder-847732-4-iscsi devstack@n-api.service[120934]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 20:14:02.287118 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 20:14:02.844076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 20:14:03.541778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:14:03.541778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: from cryptography.utils import int_from_bytes Sep 06 20:14:03.542783 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:14:03.542783 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: from cryptography.utils import int_from_bytes Sep 06 20:14:04.427394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:14:04.427394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: from cryptography.utils import int_from_bytes Sep 06 20:14:04.428267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:14:04.428267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: from cryptography.utils import int_from_bytes Sep 06 20:14:06.909736 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 20:14:06.909736 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 20:14:06.911617 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 20:14:06.912549 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 20:14:06.913039 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 20:14:06.913784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.914356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.914890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.915452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.916031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.916603 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.917173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.917792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.918413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.918905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.919464 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.920316 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-4-iscsi {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.920920 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.921485 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.922171 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.923355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.924002 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.924554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.925112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.926223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.930337 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.934059 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.934679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.935303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.936322 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.936523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.937099 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.937735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.938482 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.939261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.939942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-4-iscsi {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.940597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.941173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.941743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.942473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.942989 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.943490 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.944413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.945358 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.946271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.947155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.947919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.948664 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.949529 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.950417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.951266 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.952084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.952898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.953687 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.955083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.955766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.956601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.957496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.958390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.959221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.959839 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.960451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.961131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.962110 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.962939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.963775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.964556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.965097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.965897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.966665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.967448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.968190 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.968748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.969289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.969963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.970499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.971022 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.971678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.972032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.972757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.973323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.973895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.974457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.974942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.975788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.976390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.976950 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.977476 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.978064 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.978608 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.979128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.979556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.980113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.980669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.981255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.982102 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.982882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.983563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.984359 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.985508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.986448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.987040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.987567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.988073 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.988582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.989089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.989737 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.990504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.991254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.992076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.993072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.993749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.994456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.994947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.995429 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.995910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.996480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.997128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.997779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.998394 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.998970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:06.999584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.000185 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.002380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.002758 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.003095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.003434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.003781 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.004764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.004764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.004764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.005166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.005716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.006202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.006742 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.007070 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.007419 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.007961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.008497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.008830 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.009157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.009481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.010170 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.010549 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.010919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.011248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.011606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.011925 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.012286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.012842 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.012948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.013242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.013581 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.013978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.014299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.014622 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.014959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.015286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.015630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.015963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.016283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.016903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.017182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.017518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.017887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.018220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.018546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.018898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.019257 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.019582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.020049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.020414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.020893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.021224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.021545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.022037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.022368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.022694 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.023149 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.023350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.023691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.024048 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.024368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.024731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.025028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.025351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.025775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.026114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.026466 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.027062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.027273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.027607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.027952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.028365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.028689 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.029105 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.029426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.029764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.030093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.030409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.030749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.031094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.031413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.031789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.033317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.033501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.033855 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.035181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.035181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.035181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.035181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.035865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.035865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.036170 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.036376 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.036754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.037237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.037558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.037977 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.038240 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.038634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.038969 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.039290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.039677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.040237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.040807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.041519 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.042113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.042628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.043248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.043826 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.046489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.046489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.046489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.046489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.048042 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.048042 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.048042 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.048489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.049085 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.049821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.049997 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.050503 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.051094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.051700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.052255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.052803 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.053364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.054021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.054611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.055207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.055827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.056395 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.056979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.057797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.058572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.059035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.059543 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.060111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.060838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.061295 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.061901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.062492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.063062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.064193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.064757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.065357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.065952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.066542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.067165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.067832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.068434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.069049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.069704 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.070257 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.070820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.071290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.071760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.072233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.072757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.073215 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.073717 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.074260 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.074787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.075353 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.075899 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.076417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.076984 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.077577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.078126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.078607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.079165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.079677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.080166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.080691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.081221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.081802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.082356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.082921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.083497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.084102 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.084695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.085254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.085998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.086555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.087117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.087674 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.088263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.088866 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.089422 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.090041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.090629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.091237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.091797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.092420 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.093058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.093653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.094205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.095298 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.095938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.096530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.097106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.097746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.098362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.098963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.099551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.100194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.100651 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.101269 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.102027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.102554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.103152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.103750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.104357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.104949 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.105535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.106057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.106563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.107033 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.107529 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.108010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.108483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.109474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.110004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.110677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.111225 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.111836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.112434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.113030 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.113640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.114233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.115240 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.115592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.116049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.116555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.117050 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.117509 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.118004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.118537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.119020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.119547 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.120052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.120625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.121149 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.122701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.123298 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.123868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.124421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.125023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.125600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.126752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.127316 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.127843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.128459 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.129020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.129727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.130328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.130979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.131542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.132101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.132680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.133310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.133827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.134390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.134962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.135525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.136090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.136927 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.137237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.137825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.138388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.138968 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.139551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.140125 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.141385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.141385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.142054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.142645 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.143219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.143797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.144367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.144954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.145544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.146183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.146749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.147330 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.147904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.148463 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.148963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.149450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.150015 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.150522 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.151019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.151506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.151995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.152479 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.152958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.153445 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.154006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.154505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.155011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.155523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.156085 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.156520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.157903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.158266 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.158843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.159226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.159702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.160233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.160660 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.161273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.161788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.162363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.162923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.163487 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.164126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.164692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.165352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.166058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.166625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.167193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.167700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.168198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.168700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.169184 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.169708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.170205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.170705 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.171187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.171663 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.172179 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.172797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.173305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.173846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.174357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.174872 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.175358 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.175848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.176339 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.176823 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.177309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.177827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.178331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.178800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.179290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.179775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.180265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.180749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.181256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.181860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.182418 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.183030 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.183594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.184151 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.184718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.185266 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.185918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.186570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.187398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.187985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.189162 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.189494 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.189853 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.190187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.190639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.191076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.191410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.191921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.192251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.192626 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.193283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.193568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.193876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.194115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.194364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.194870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.195107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.195483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.195724 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.196195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.196453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.196715 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.197439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.197802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.198363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.198629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.199298 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.199515 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.199830 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.200177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.200562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.201059 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.201764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.202244 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.202630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.203185 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.203736 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.204248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.204570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.204984 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.205429 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.205657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.206136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.207124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.207124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.207468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.208056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.208658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.209231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.209870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.210348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.210862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.211211 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.211534 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.211856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.212234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.212558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.212877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.213275 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.213751 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.213996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.214376 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.214707 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.215243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.215576 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.215903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.216285 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.216554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.216870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.217185 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.217502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.217895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.218213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.218544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.218884 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.219302 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.220473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.220839 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.221206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.221658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.221985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.222322 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.222685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.223001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.223351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.223749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.224194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.224554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.224921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.225233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.225554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.225892 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.226202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.226536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.226847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.227177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.227494 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.227808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.228122 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.228785 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.229189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.229535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.229912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.230243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.230587 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.231162 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.231737 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.232306 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.232835 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.233386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.233981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.234592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.235095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.235586 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.236235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.236723 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.237500 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.238066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.238583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.239083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.239780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.240087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.240691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.241090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.241582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.242113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.242608 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.243146 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.243662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.244189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.244722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.245251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.245763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.246299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.246722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.247250 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.247722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.248223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.248727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.249225 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.249958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.250256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.251481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.251801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.252303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.252810 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.253302 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.253843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.254342 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.254902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.255409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.255925 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.256429 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.256929 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.257436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.258364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.258905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.259412 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.260194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.260434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.260942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.261456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.262097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.262603 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.263094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.263593 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.264097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.264588 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.265214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.265431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.265943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.266524 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.266858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.267549 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.267911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.268414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.268961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.269456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.269996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.270487 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.271003 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.271488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.271978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.272483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.272976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.273464 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.273977 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.274470 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.274987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.275429 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.275945 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.276469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.277074 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.277416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.277786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.278141 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.278514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.278809 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.279322 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.279807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.280335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.280787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.281272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.282789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.283226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.283730 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.284291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.284782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.285280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.285834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.286315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.286798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.287413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.287953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.288499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.289022 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.289703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.290031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.290583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.291082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.291408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.291876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.292413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.293032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.293426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.293958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.294440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.294986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.295440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.295937 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.296427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.296914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.297410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.298172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.298657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.299156 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.299685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.300197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.300729 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.301293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.301732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.302213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.302715 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.303259 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.303551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.303883 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.304212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.304542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.304864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.305184 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.305507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.305849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.306182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.306551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.306839 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.307183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.307608 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.307933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.308262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.308595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.308911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.309241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.309667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.310001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.310326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.310644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.310987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.311337 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.311671 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.312000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.312315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.312632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.312977 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.313930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.314466 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.314623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.314885 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.315196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.315589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.315822 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.316130 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.316531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.316847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.317163 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.317474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.317812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.318126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.318436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.318767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.319049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.319363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.319672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.319981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.320393 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.320708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.321054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.321468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.321817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.322136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.322463 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.322788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.323115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.323427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.323754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.324176 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.324681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.324840 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.325199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.325773 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.325972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.326343 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.326797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.327280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.327675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.328055 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.328457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.329031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.329379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.329809 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.330184 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.330555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.330988 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.331380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.331832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.332238 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.332712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.333152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.333572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.333985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.334376 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.334716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.335097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.335459 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.335917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.336221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.336583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.337007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.337394 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.337849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.338214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.338687 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.339232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.339549 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.339922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.340289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.340577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 20:14:07.417320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO dbcounter [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Registered counter for database nova_api Sep 06 20:14:07.439940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_db.sqlalchemy.engines [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:07.448026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writer thread running {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:07.509181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.context [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),089655f8-2bf0-4b56-ad47-918579e24a3f(cell1) {{(pid=120952) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 20:14:07.513669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:14:07.514146 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:14:07.515808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:14:07.517084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:14:07.517547 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:14:07.519964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:14:07.522052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO dbcounter [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Registered counter for database nova_cell0 Sep 06 20:14:07.526620 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO dbcounter [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Registered counter for database nova_cell1 Sep 06 20:14:07.536452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_db.sqlalchemy.engines [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:07.540757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_db.sqlalchemy.engines [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:07.542713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writer thread running {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:07.567473 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 20:14:07.570103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 20:14:07.570103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 20:14:07.570103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 20:14:07.570103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 20:14:07.570796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.571407 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.572012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.572591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.573672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.573869 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.574397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.574991 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.575620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.576161 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.576757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.577453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-4-iscsi {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.578095 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.578665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.579772 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.580933 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.581545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.582192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.583135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.583711 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.584288 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.584882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.585751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.586376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.586949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.587551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.588136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.588752 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.589341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.590126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-4-iscsi {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.590721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.591306 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.591885 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.592728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.593324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.593995 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.604059 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.605825 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.605825 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.606125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.606741 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.607338 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.608166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.608510 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.609106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.610034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.611687 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.612608 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.613365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.614130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.614886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.615955 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.616605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.617462 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.618145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.618631 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.619164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.619856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.620554 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.621357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.622057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.623507 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.624119 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.624722 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.625289 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.625988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.626924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.627659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.628256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.630861 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.630861 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.630861 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.631347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.631778 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.632436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.633086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.633644 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.634236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.635070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.635639 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.636193 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.636775 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.637396 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.638290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.640658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.640658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.640658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.641139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.641305 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.650015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.655758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.658062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.659941 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.659941 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.659941 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.659941 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.659941 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.661091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.661336 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.661777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.662351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.662935 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.663503 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.664046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.664553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.665050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.665543 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.666084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.666598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.667084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.667647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.668097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.668589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.669084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.669572 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.670119 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:14:07.670672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.671596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.672140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.673248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.673809 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.674321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.674828 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.675323 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.675826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.676343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.676859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.677332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.677851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.678358 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.678866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.679395 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.679944 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.680495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.681033 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.681735 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.682257 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.682788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.683408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.683849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.684326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.684846 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.685350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.685911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.686423 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.686926 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.687420 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.687924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.688570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.689080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.689553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.690136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.690563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.690904 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.691236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.691701 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.692036 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.692361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.692722 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.693080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.693511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.693930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.694382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.694712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.695039 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.695366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.695686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.696007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.696323 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.697078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.697574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.698225 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.698562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.699065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.700561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.701751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.702311 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.702827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.703021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writer thread running {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:07.703614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.704765 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.705108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.705437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.705801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.706132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.706453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.706801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.707474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.707793 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.708245 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.708609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.708933 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.709264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.709588 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.710666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.711369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.712058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.712588 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.713093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.713589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.713995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO dbcounter [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Registered counter for database nova_cell0 Sep 06 20:14:07.714156 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.714664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.715150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.715665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.716248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.717339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.717876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.718238 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.718714 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.719063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.719634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.719962 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.720282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.720598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.720916 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.721232 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.721557 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.722124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.722500 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.722819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.723134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.723454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.723851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.724167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.724342 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_db.sqlalchemy.engines [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:07.724519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.725105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.725876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.726398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.726887 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.727622 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.728156 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.728656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.729152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.729672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.730183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.730666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writer thread running {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:07.730839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.731178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.731689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.732285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.732798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.733303 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.733686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.733984 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.734335 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.734874 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.735248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.735576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.736087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.736703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.737027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.737351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.738416 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.738766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.739102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.739498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.740011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.740503 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.741027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.741508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.742325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.743079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.743590 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.744301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.744717 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.745133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.745677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.746192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.746706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.747215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.747728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.748180 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.748649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.749067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.749402 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.749757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.750078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.750398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.751253 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.751576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.751890 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.752201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.752537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.752865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.753190 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.753506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.754071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.754581 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.754894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.755231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.755573 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.755854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.756345 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.756859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.757029 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.757310 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.757802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.758292 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.758647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.758986 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.759313 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.759634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.759949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.760281 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.760602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.760922 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.761290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.761595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.761950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.762269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.762600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.762945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.763225 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.763713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.764025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.764447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.764769 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.765382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.765901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.766339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.766743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.767100 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.767496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.767808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.768348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.768609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.768938 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.769173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.769429 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.769723 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.769980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.770235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.770761 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.771024 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.771262 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.771511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.771761 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.772013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.772340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.772765 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.773094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.773441 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.773861 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.774262 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.774522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.774807 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.775200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.775515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.775966 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.776394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.776855 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.777324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.777781 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.778026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.778314 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.778871 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.779120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.779366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.779610 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.779970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.780357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.780947 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.781185 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.781468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.782577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.783033 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.783350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.783670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.784009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.784448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.784707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.784952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.785267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.785736 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.786106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.786569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.787008 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.787347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.787827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.788219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.788454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.788728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.789272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.789272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.789782 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.790034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.790404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.790728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.791291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.791548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.791787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.792024 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.792268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.792560 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.792883 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.793301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.793724 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.794046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.794287 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.794543 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.794932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.795183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.795523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.796594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.796971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.797325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.797939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.798235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.798632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.798881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.799141 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.799786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.800219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.800585 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.800909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.801500 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.801802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.802048 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.802298 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.802571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.802838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.803200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.803621 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.804200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.804200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.804678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.804949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.805374 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.805602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.805910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.806208 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.806542 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.806855 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.807182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.807621 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.807897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.808341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.808612 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.808999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.809676 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.809676 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.810160 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.810396 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.810710 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.811014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.811336 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.811932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.812175 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.812426 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.812666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.812917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.813721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.814346 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.814756 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.814999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.815256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.815658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.815910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.816208 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.816528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.816848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.817173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.817483 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.818037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.818574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.818836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.819344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.819344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.820175 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.820175 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.820175 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.820898 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.820898 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.821389 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.821719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.822453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.822453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.822997 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.822997 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.823468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.823732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.824002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.824483 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.824757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.825017 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.825275 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.825525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.825986 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.826234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.826566 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.826894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.827212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.827537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.827846 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.828263 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.828839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.829134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.829583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.829952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.830521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.830521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.831012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.831265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.831516 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.831785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.832052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.832881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.832881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.832881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.833663 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.833663 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.834192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.834667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.834667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.835171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.835438 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.835703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.835993 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.836386 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.836651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.836903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.837187 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.837449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.837824 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.838133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.838555 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.838865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.839355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.839775 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.840035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.840628 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.840888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.841143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.841539 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.841906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.842223 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.842687 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.843112 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.843403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.843658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.843911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.844166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.845152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.845486 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.845815 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.846130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.846569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.846823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.847067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.847381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.847697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.848028 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.848414 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.848724 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.848979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.849235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.849780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.850252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.850252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.851094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.851094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.851620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.851620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.852108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.852108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.852649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.853079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.853079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.854727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.856207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.856666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.857037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.857693 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.858054 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.858392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.858724 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.859060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.859393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.859721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.860104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.860442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.860767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.861089 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.861532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.862380 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.862727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.863402 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.863746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.864076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.864408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.864766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.865109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.865437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.865784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.866121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.866445 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.867287 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.867287 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.867796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.867796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.868129 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.868355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.868660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.868982 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.869300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.869660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.870079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.870415 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.870748 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.871043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.871621 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.871950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.872269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.872613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.872946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.873269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.873719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.873987 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.874237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.874576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.874910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.875304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.875628 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.875628 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.877001 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.877265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.877524 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.877863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.878127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.878697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.879139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.880092 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.880595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.881007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.881271 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.881881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.881881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.882377 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.882669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.882912 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.883169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.883448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.883875 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.884135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.884400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.884663 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.884920 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.885237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.885568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.886428 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.886745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.887058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.887379 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.887691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.888009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.888330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.888636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.888959 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.889353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.889698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.890023 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.890405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.890830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.891108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.891496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.891836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.892292 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.892609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.892932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.893252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.893583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.894599 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.894973 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.895647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.896326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.897653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.898088 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.898704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.899341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.899979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.900816 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.901731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.902518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.903165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.903776 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.904385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.904923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.905716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.909437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.910459 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.911547 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.912584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.913442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.914415 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.915254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.916062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.916661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.917205 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.917931 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.918509 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.919133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.919869 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.920489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.921106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.921819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.922469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.923150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.923746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.924872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.924998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.925670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.926498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.927502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.928117 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.928805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.929365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.930026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.930666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.931291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.931978 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.934716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.934716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.934716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.934716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.935564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.935856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.936689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.937218 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.938873 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.938873 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.939445 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.940064 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.940638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.941197 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.941851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.942448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.943048 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.943647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.944230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.944829 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.945727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.946047 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.946651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.947321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.947925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.948529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.949152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.949789 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.950398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.950988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.951593 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.952198 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.953422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.953590 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.954235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.954923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.955508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.956151 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.956763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.957380 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.958060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.959703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.959703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.960015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.960389 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.961007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.961597 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.962238 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.962903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.963394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.965457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.965457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.965457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.965884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.968041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.968041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.968041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.968041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.968666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.970426 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.970426 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.970647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.970879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.971463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.972051 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.973602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.973602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.973918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.974404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.975054 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.975692 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.976277 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.976690 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.977077 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.977651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.978482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.979829 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.979829 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.979829 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.980324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.980795 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:14:07.981222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 20:14:08.103120 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: WARNING keystonemiddleware.auth_token [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:14:08.111719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: WARNING keystonemiddleware.auth_token [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:14:08.174484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO dbcounter [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Registered counter for database nova_api Sep 06 20:14:08.207707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_db.sqlalchemy.engines [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:08.219580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writer thread running {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:08.333106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.context [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),089655f8-2bf0-4b56-ad47-918579e24a3f(cell1) {{(pid=120951) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 20:14:08.341187 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:14:08.342160 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:14:08.345917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:14:08.347377 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:14:08.348326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:14:08.352661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:14:08.356996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO dbcounter [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Registered counter for database nova_cell0 Sep 06 20:14:08.366272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO dbcounter [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Registered counter for database nova_cell1 Sep 06 20:14:08.382236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_db.sqlalchemy.engines [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:08.383530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_db.sqlalchemy.engines [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:08.393035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writer thread running {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:08.473442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: WARNING keystonemiddleware.auth_token [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:14:08.480112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: WARNING keystonemiddleware.auth_token [None req-8bae3fef-b018-468c-a0a6-3e2494caa652 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:14:08.485876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e4806cb9c0 pid: 120952 (default app) Sep 06 20:14:08.598128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writer thread running {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:08.607785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO dbcounter [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Registered counter for database nova_cell0 Sep 06 20:14:08.615762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_db.sqlalchemy.engines [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:14:08.622690 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writer thread running {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:14:08.968649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: WARNING keystonemiddleware.auth_token [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:14:08.977170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: WARNING keystonemiddleware.auth_token [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:14:09.355942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: WARNING keystonemiddleware.auth_token [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 20:14:09.363469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: WARNING keystonemiddleware.auth_token [None req-ba00f074-440a-49e0-9ba4-1ad3cc5b4f15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 20:14:09.369695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55e4806cb9c0 pid: 120951 (default app) Sep 06 20:15:05.105793 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:05.122447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:05.124503 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:05.126429 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:06.876408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1091741284", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:09.126657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] validate_networks() for [('568e35b6-fbc9-4b87-a50a-12e269b16c2c', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:15:13.315037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:15:13.316315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:15:13.317024 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:15:13.317682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:15:13.318409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:15:13.356413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:13.357386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:13.358115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:13.359293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:13.360112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:13.360792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:13.454419 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for project b005ff023a9f46fda3ceef605996c385. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:13.473281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for user ecde3e4bfd8b4f3490edd3832cea9e48 and project b005ff023a9f46fda3ceef605996c385. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:13.511599 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:15:13.519542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:15:13.672910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f0dafbbd-cc6f-4376-9a48-0d30a8d5c53a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.599050 Sep 06 20:15:13.674607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:15:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 8604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:15:14.830606 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4f07e78c-5a16-4ddd-9bb9-ef89a7e4fc78 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:14.832043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4f07e78c-5a16-4ddd-9bb9-ef89a7e4fc78 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:14.834842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:14.835991 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:14.837703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:14.838613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:14.871793 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5d636ce0-9cea-40b8-ae9d-bfaf634fea7e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'create', calling method: .version_select at 0x7f9c37feb310>, body: {"keypair": {"name": "tempest-keypair-1336345385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/gXl914l4/LcCwOGlMowKBUZL/uMdhji0u4fNCY+F0gx4gak6BJu4BtQjyTZMnzTJrByb0JjlDYm3V24353tZaf/GpsKaBy052EJ0i7PhhfKq7JY3XvDjYylIxB6ouXQ=="}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:14.966472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-5d636ce0-9cea-40b8-ae9d-bfaf634fea7e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:14.983567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-5d636ce0-9cea-40b8-ae9d-bfaf634fea7e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for user f49ef54a38614cb880577626e65b0e32 and project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:15.087692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5d636ce0-9cea-40b8-ae9d-bfaf634fea7e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.916303 Sep 06 20:15:15.096713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 2/2] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:15:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:15:15.819101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4f07e78c-5a16-4ddd-9bb9-ef89a7e4fc78 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:15.892664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4f07e78c-5a16-4ddd-9bb9-ef89a7e4fc78 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1222 microversion: 2.1 time: 2.198992 Sep 06 20:15:15.897838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:13 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1222 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:16.280694 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1653727709", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:16.448782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] validate_networks() for [('568e35b6-fbc9-4b87-a50a-12e269b16c2c', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:15:21.494364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:15:21.495577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:15:21.497150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:15:21.498240 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:15:21.500460 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:15:21.538208 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:21.539456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:21.544719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:21.550239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:21.555114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:21.557863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:21.729455 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for project b005ff023a9f46fda3ceef605996c385. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:21.765204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for user ecde3e4bfd8b4f3490edd3832cea9e48 and project b005ff023a9f46fda3ceef605996c385. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:21.852811 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:15:21.864950 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:15:22.238442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f1ccf591-008e-401a-b4e7-bc1a84114a2a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.962521 Sep 06 20:15:22.268995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 3/4] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:15:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 5994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:15:22.277489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-19b6e550-bbf2-43c5-81ce-ffb8ebd07dd3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:22.286173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-19b6e550-bbf2-43c5-81ce-ffb8ebd07dd3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:23.327264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-19b6e550-bbf2-43c5-81ce-ffb8ebd07dd3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:23.391743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-19b6e550-bbf2-43c5-81ce-ffb8ebd07dd3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1222 microversion: 2.1 time: 1.119829 Sep 06 20:15:23.401192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 2/5] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:22 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1222 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:15:24.450793 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6a1f0493-ee38-4cce-8a7e-8ea84db75e3d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:24.456623 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6a1f0493-ee38-4cce-8a7e-8ea84db75e3d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:24.894752 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6a1f0493-ee38-4cce-8a7e-8ea84db75e3d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:24.904057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a2bb493a-1f4d-49e2-aaf2-cca77ffd660f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: .version_select at 0x7f9c37f9b700>, body: {"keypair": {"name": "tempest-keypair-1676454569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFubUVwkgBX/Av1d0fpX/C5BYVVnYUs1O4eL3s2tqGggGz330k7hpzQlQqHWJ+IcpeJ+iDvxPD1Co/Bm3j1dQ2InGSz5Jk2IknFeGMVCMzW1M943Vx8lo+9OsebjaUNynA=="}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:24.954301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6a1f0493-ee38-4cce-8a7e-8ea84db75e3d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1222 microversion: 2.1 time: 0.495493 Sep 06 20:15:24.955742 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:24 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1222 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:25.026455 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-a2bb493a-1f4d-49e2-aaf2-cca77ffd660f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:25.063803 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-a2bb493a-1f4d-49e2-aaf2-cca77ffd660f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:25.277467 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a2bb493a-1f4d-49e2-aaf2-cca77ffd660f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.993222 Sep 06 20:15:25.291970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 4/7] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:15:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:15:26.012545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:26.014905 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:26.093783 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:26.103960 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:26.110684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:26.118021 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:26.123153 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:26.125391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:28.193059 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:28.283034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-65e4879b-942f-404a-9149-6cb9e853e43a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1218 microversion: 2.1 time: 2.284786 Sep 06 20:15:28.318046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:25 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1218 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:28.638243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c1c43a5c-646c-4651-8584-9d4d5f4950f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'create', calling method: .version_select at 0x7f9c37ffef70>, body: {"keypair": {"name": "tempest-keypair-1733328091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3TljkRB2gwca6HWJ34A4KV9DS4ydFTzul0s5Jcog2o8fggJFUZn82F2wNvFjAFCnefKVs5VBTqXxdxJWcBprrBbGhlaDigK9x57Ah3tiaBxSTIyNd0qUsN4+UjhU/8uw=="}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:28.745883 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-c1c43a5c-646c-4651-8584-9d4d5f4950f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:28.770640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-c1c43a5c-646c-4651-8584-9d4d5f4950f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for user 7be957f2c15c4f6f949b3f284a30624d and project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:28.923888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c1c43a5c-646c-4651-8584-9d4d5f4950f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 2.063648 Sep 06 20:15:28.928134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 5/9] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 20:15:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 2072 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 20:15:29.359753 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:29.366651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:29.384586 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:29.386405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:29.401199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:29.403307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:29.405579 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:29.408323 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:30.021046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:30.073238 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5f3aeba9-b378-4a7c-a1ca-3c76a6fc2706 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1280 microversion: 2.1 time: 0.717508 Sep 06 20:15:30.097654 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:29 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1280 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:15:31.153757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:31.164930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:31.179140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1991065232", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "networks": [{"uuid": "3aac8898-c295-4cee-ada9-e7ae10d8cc7b"}]}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:31.244212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:31.247736 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:31.256426 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:31.269650 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:31.271629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:31.281762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:31.634446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] validate_networks() for [('3aac8898-c295-4cee-ada9-e7ae10d8cc7b', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:15:31.705331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=4 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:31.713094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=4 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:32.464127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:32.487298 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ec7a444c-9f4e-4d77-8dd8-a0d281023680 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1280 microversion: 2.1 time: 1.354051 Sep 06 20:15:32.495587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:31 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1280 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:15:33.530489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:33.542895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:33.583236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:33.584244 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:33.585037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:33.586371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:33.600604 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:33.601435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:34.108200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:34.126352 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e718fb34-dc5b-483f-9b50-c113c60a4d2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1280 microversion: 2.1 time: 0.598046 Sep 06 20:15:34.143601 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:33 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1280 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:34.168521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1885696851", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dacf4c35-a63a-4380-9dbf-e31cb5379429"}], "security_groups": [{"name": "tempest-securitygroup--831604949"}], "key_name": "tempest-keypair-1336345385", "user_data": "}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:34.225799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:15:34.226619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:15:34.226805 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:15:34.227406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:15:34.227980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:15:34.270346 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:34.274473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:34.276307 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:34.284138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:34.286120 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:34.291443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:34.412366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Getting quotas for project d3f88491a2ee4a03b15cb8c88a9aaf9b. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:34.433480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Getting quotas for user 48cca45629ef4e09aac4262616e2792f and project d3f88491a2ee4a03b15cb8c88a9aaf9b. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:34.523419 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:15:34.541916 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:15:34.844712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d446aa9d-9217-496e-bc3c-b4eeead7ea98 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.457031 Sep 06 20:15:34.847968 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 6/13] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 20:15:34.902699 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=6 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:34.920368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dd536a85-b425-49cf-bd05-39efc651a614 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:34.930337 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-dd536a85-b425-49cf-bd05-39efc651a614 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:35.394638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] validate_networks() for [('dacf4c35-a63a-4380-9dbf-e31cb5379429', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:15:35.623253 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-dd536a85-b425-49cf-bd05-39efc651a614 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:35.627559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=31 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:35.752397 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-dd536a85-b425-49cf-bd05-39efc651a614 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1215 microversion: 2.1 time: 0.870281 Sep 06 20:15:35.753066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:34 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1215 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:35.772238 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:35.772947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:35.775366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=12 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:35.807238 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:35.810525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:35.810525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:35.810525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:35.810525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:35.824819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:36.335490 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:36.390915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bbf79282-321a-47bf-8d10-80b81dac43c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1280 microversion: 2.1 time: 0.636435 Sep 06 20:15:36.391606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:35 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1280 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:36.808931 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:36.819640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:36.856029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:36.857293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:36.863637 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:36.865438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:36.871320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:36.874304 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:37.666049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:37.680012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9fcadbba-cf58-425d-a51a-375c7f09dcc3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1211 microversion: 2.1 time: 0.890411 Sep 06 20:15:37.705462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:36 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1211 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:15:37.727333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:37.728310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:37.755817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:37.756757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:37.757570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:37.761136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:37.763675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:37.767944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:39.707165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:39.788460 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-42633e6a-aa17-42a0-8948-48ef05258c6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 2.047912 Sep 06 20:15:39.790641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 10/17] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:37 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:39.821871 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:39.825148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:39.840607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:39.841446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:39.843654 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:39.847533 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:39.849060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:39.851608 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:40.282127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:40.309778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-07fa9efb-751b-4202-bdf3-265e0cdacc30 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1273 microversion: 2.1 time: 0.517101 Sep 06 20:15:40.310775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 11/18] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:39 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1273 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:40.821834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:40.823650 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:40.854740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:40.855631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:40.856403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:40.857356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:40.858053 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:40.858730 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:41.759643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:15:41.760436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:15:41.760719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:15:41.761161 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:15:41.761734 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:15:41.797528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:41.798005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:41.798605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:41.799490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:41.800070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:41.800484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:42.009075 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:42.034490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for user f49ef54a38614cb880577626e65b0e32 and project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:42.103070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:15:42.106779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:15:42.337879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9e265560-56e5-4873-94c9-4403a7b92fd8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 8.187136 Sep 06 20:15:42.339487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 8/19] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:15:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 8195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:15:42.350984 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:42.352462 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:42.369632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:42.371135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:42.373155 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:42.375341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:42.378805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:42.379836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:42.831784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:42.846116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2846f0f6-3437-414f-9bcd-da6651ed5933 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 2.022049 Sep 06 20:15:42.847418 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 12/20] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:40 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:42.860136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2009717967", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1afac54-5c6c-4b09-a9a4-d3257ac1482d"}], "security_groups": [{"name": "tempest-securitygroup--1132015180"}], "key_name": "tempest-keypair-1676454569", "user_data": "}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:43.465008 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] validate_networks() for [('d1afac54-5c6c-4b09-a9a4-d3257ac1482d', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:15:43.614341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:43.678494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c6c25ebf-f260-43a9-b8a7-91e92f1411b7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1273 microversion: 2.1 time: 1.335021 Sep 06 20:15:43.680913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 9/21] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:42 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1273 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:43.712368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7b3604b1-703e-47c8-8910-5c0a8cbd79c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:43.717365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7b3604b1-703e-47c8-8910-5c0a8cbd79c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:44.108102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7b3604b1-703e-47c8-8910-5c0a8cbd79c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:44.128503 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7b3604b1-703e-47c8-8910-5c0a8cbd79c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1238 microversion: 2.1 time: 0.439715 Sep 06 20:15:44.131848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 10/22] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:43 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1238 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:44.146021 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:44.147870 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:44.167924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:44.170569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:44.171302 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:44.173897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:44.176901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:44.179616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:44.337432 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:45.704847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:46.263024 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:46.283669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-470282a5-6601-4f80-bc3e-13c4379f28f5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 2.149285 Sep 06 20:15:46.284512 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:44 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:46.699588 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-31b38690-b611-46ed-9db3-acd6308bc6c2 req-28c77c36-717f-448f-b632-c12a1a1c3bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c", "tag": "03b06557-9c5e-4e13-9df1-1d7acac27bc0"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:46.738451 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:46.783670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-31b38690-b611-46ed-9db3-acd6308bc6c2 req-28c77c36-717f-448f-b632-c12a1a1c3bb8 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:46.784546 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-31b38690-b611-46ed-9db3-acd6308bc6c2 req-28c77c36-717f-448f-b632-c12a1a1c3bb8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:46.785337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-31b38690-b611-46ed-9db3-acd6308bc6c2 req-28c77c36-717f-448f-b632-c12a1a1c3bb8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:46.874625 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-31b38690-b611-46ed-9db3-acd6308bc6c2 req-28c77c36-717f-448f-b632-c12a1a1c3bb8 service nova] Creating event network-changed:03b06557-9c5e-4e13-9df1-1d7acac27bc0 for instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c on hv-cinder-84773 Sep 06 20:15:46.875078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-31b38690-b611-46ed-9db3-acd6308bc6c2 req-28c77c36-717f-448f-b632-c12a1a1c3bb8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 06 20:15:46.875475 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-31b38690-b611-46ed-9db3-acd6308bc6c2 req-28c77c36-717f-448f-b632-c12a1a1c3bb8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 06 20:15:46.879772 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:46.880492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:46.883727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:46.884925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:46.887946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:46.888618 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:46.919784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.compute.rpcapi [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 20:15:46.921474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] Releasing lock "compute-rpcapi-router" {{(pid=120951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 06 20:15:46.929330 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:15:46.929904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:15:46.934484 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:15:46.936630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:15:46.938689 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:15:46.957083 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4e75f6c2-0c59-41da-981e-376db932bee4 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.671071 Sep 06 20:15:46.958780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 12/24] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:15:46.975254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:46.976118 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:46.976654 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:46.977195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:46.987710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:46.991430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:46.991691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:46.992080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:46.992226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:46.992579 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:46.992775 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:47.010496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:47.011188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:47.011681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:47.100648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:47.109457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:47.154191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:15:47.156718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:15:47.288987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b4e81c73-ae2f-433a-b6a9-58df59c28270 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.437849 Sep 06 20:15:47.289818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 13/25] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:15:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 4440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:15:48.122215 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-06381c72-eae0-4e73-a0cd-bc0a2b25844e req-1246e9b5-020c-4976-85ef-0b3128db3f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3195da2b-23fc-4ec2-8c0e-69babd249087", "tag": "339442d0-dfaf-4373-a89f-2acfe395baa1"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:48.182722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-06381c72-eae0-4e73-a0cd-bc0a2b25844e req-1246e9b5-020c-4976-85ef-0b3128db3f00 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:48.185468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-06381c72-eae0-4e73-a0cd-bc0a2b25844e req-1246e9b5-020c-4976-85ef-0b3128db3f00 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:48.186040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-06381c72-eae0-4e73-a0cd-bc0a2b25844e req-1246e9b5-020c-4976-85ef-0b3128db3f00 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:48.207038 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:48.228931 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-46e125a5-aeaa-4af8-a67a-c4f106d76c46 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 1.268510 Sep 06 20:15:48.234403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:46 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:48.252582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-06381c72-eae0-4e73-a0cd-bc0a2b25844e req-1246e9b5-020c-4976-85ef-0b3128db3f00 service nova] Creating event network-changed:339442d0-dfaf-4373-a89f-2acfe395baa1 for instance 3195da2b-23fc-4ec2-8c0e-69babd249087 on hv-cinder-84773 Sep 06 20:15:48.254986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-06381c72-eae0-4e73-a0cd-bc0a2b25844e req-1246e9b5-020c-4976-85ef-0b3128db3f00 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 06 20:15:48.255903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:48.256521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:48.256642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-06381c72-eae0-4e73-a0cd-bc0a2b25844e req-1246e9b5-020c-4976-85ef-0b3128db3f00 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 06 20:15:48.264210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:48.265024 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:48.266090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:48.272214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:48.273928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:48.274997 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:48.286802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:48.289310 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:48.292162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:48.294614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:48.296160 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:48.300340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:48.306511 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.compute.rpcapi [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 20:15:48.307882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] Releasing lock "compute-rpcapi-router" {{(pid=120952) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 06 20:15:48.337423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bf432e5b-ecff-4ff5-ab12-967a0345a926 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043205 Sep 06 20:15:48.339270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 14/27] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:15:48.358992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1869067282", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "912564fd-af22-4c52-b66c-ce5ba337c4b5"}], "security_groups": [{"name": "tempest-securitygroup--717200860"}], "key_name": "tempest-keypair-1733328091", "user_data": "}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:48.527069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:48.549158 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-eaf8addb-ac4a-438b-aa85-e674c0f9b520 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1296 microversion: 2.1 time: 0.313295 Sep 06 20:15:48.552611 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:48 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1296 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:48.604616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:48.607793 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:48.628093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:48.632977 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:48.634031 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:48.635863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:48.638707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:48.640482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:48.822807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] validate_networks() for [('912564fd-af22-4c52-b66c-ce5ba337c4b5', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:15:49.053820 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:49.093418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-53483dfc-c18d-41b0-b09d-00030c49b6f6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1246 microversion: 2.1 time: 0.501137 Sep 06 20:15:49.106277 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:48 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1246 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:49.132038 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:49.137797 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:49.162785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:49.163727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:49.164518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:49.166012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:49.167059 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:49.168037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:50.244100 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:50.286961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-375d758f-3067-4830-afd2-ff10c9637a68 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 1.177599 Sep 06 20:15:50.288969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:49 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:50.299442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-41843f67-d694-48eb-9455-e7ab1bb4c7b6 req-524c7883-b80c-489e-8c75-46a90c505bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62393da-6c69-4bac-8616-2d32da12ca1b", "tag": "19274d4d-c555-42bb-8fb2-8b7204647a39"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:50.328443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-41843f67-d694-48eb-9455-e7ab1bb4c7b6 req-524c7883-b80c-489e-8c75-46a90c505bbc service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:50.330028 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-41843f67-d694-48eb-9455-e7ab1bb4c7b6 req-524c7883-b80c-489e-8c75-46a90c505bbc service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:50.332086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-41843f67-d694-48eb-9455-e7ab1bb4c7b6 req-524c7883-b80c-489e-8c75-46a90c505bbc service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:50.374428 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-41843f67-d694-48eb-9455-e7ab1bb4c7b6 req-524c7883-b80c-489e-8c75-46a90c505bbc service nova] Creating event network-changed:19274d4d-c555-42bb-8fb2-8b7204647a39 for instance a62393da-6c69-4bac-8616-2d32da12ca1b on hv-cinder-84773 Sep 06 20:15:50.387920 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-41843f67-d694-48eb-9455-e7ab1bb4c7b6 req-524c7883-b80c-489e-8c75-46a90c505bbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096369 Sep 06 20:15:50.393013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 17/31] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:15:50.416025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:50.420323 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:50.433407 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:50.434570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:50.435884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:50.437737 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:50.438827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:50.439830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.047301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:51.073580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-03a8f4ae-48aa-4b7c-86a9-9f86709c378a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.675192 Sep 06 20:15:51.082174 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 18/32] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:50 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:51.104091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:51.109280 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:51.133398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.135683 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.139116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.145777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.147413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.151558 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.431654 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:51.446162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-548d2658-50ee-434f-af8e-03c112d5d002 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1296 microversion: 2.1 time: 0.362395 Sep 06 20:15:51.450431 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 19/33] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:51 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1296 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:51.460082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:51.466298 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:51.482625 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.487109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.490166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.492770 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.498152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.499226 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.576206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:15:51.576870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:15:51.577881 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:15:51.578742 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:15:51.579653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:15:51.618240 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.622688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.630166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.631655 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.633320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.634420 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.708029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:15:51.721811 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for user 7be957f2c15c4f6f949b3f284a30624d and project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:15:51.781349 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:15:51.787237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:15:51.831400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:51.867265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-031860b9-5fed-4ff2-b2ca-a618366b4ceb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1300 microversion: 2.1 time: 0.413925 Sep 06 20:15:51.869179 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 20/34] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:51 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1300 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:51.885273 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:51.886931 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:51.916292 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.917943 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.927613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:51.929326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:51.930763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:51.931987 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:52.063493 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b04046f2-2f36-43a3-9b82-bc7c1b2b22f1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.718791 Sep 06 20:15:52.081359 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 15/35] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 20:15:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 3739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 20:15:52.097369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dd9df0b7-6221-4d2a-a0fa-385d4a4d55ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:52.118860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-dd9df0b7-6221-4d2a-a0fa-385d4a4d55ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:52.586863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-dd9df0b7-6221-4d2a-a0fa-385d4a4d55ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:52.666332 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-dd9df0b7-6221-4d2a-a0fa-385d4a4d55ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:52.673900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-dd9df0b7-6221-4d2a-a0fa-385d4a4d55ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:52.678777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-dd9df0b7-6221-4d2a-a0fa-385d4a4d55ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1282 microversion: 2.20 time: 0.591001 Sep 06 20:15:52.682344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 16/36] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:15:52 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1282 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:15:52.702406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:52.707740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:52.743897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:52.744992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:52.750145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:52.752487 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:52.756526 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:52.758605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:53.514134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:53.533589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fbed8407-cb62-4a26-b94c-8cbd3082a373 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.847666 Sep 06 20:15:53.534507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:52 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:53.550509 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:53.551979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:53.573463 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:53.574286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:53.575041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:53.576013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:53.576884 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:53.577689 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:53.673197 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:53.699612 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8324fcc4-fc06-408b-a7ba-c1e71772e0b1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 1.826879 Sep 06 20:15:53.702569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 21/38] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:51 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:53.736199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:53.737301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:53.750803 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:53.751737 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:53.752532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:53.754695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:53.756414 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:53.757291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:53.990352 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:54.018497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4ba8e397-7629-4be4-94fb-b71334329947 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1300 microversion: 2.1 time: 0.313368 Sep 06 20:15:54.033658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 22/39] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:53 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:54.033658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:54.033658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:54.049586 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:54.051501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:54.051780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:54.055102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:54.055102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:54.055102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:54.063984 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:54.127665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=8 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:54.276620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:54.305823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:54.314130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:54.317438 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bbd7eed2-e248-4fd6-9b60-165a1752664d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1286 microversion: 2.20 time: 0.294515 Sep 06 20:15:54.338742 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 23/40] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:15:54 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1286 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:15:54.437570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:54.458479 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-10ca0480-d930-4ffa-86ca-4a958a27317a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.920963 Sep 06 20:15:54.474404 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 18/41] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:53 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:54.580253 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:54.581130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:54.627922 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:54.630976 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:54.632467 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:54.634827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:54.636480 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:54.644611 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:54.736748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:54.743178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:54.782817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:54.783749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:54.784543 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:54.793544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:54.799551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:54.802048 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.474327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:55.498959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-eeb27b66-e4fb-4920-ac27-b11d47b9a074 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.772068 Sep 06 20:15:55.521508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 19/42] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:54 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:55.533297 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-198a69a6-736a-4b92-b9dc-16064320e4c7 req-b72126c4-d5da-4dfa-a191-d56f3deaad87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f25258-270e-479e-b6d2-5dc39da2f3a5", "tag": "576fc76a-50fd-4ff9-80cc-ee131fbb00c3"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:55.553320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-198a69a6-736a-4b92-b9dc-16064320e4c7 req-b72126c4-d5da-4dfa-a191-d56f3deaad87 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:55.555118 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-198a69a6-736a-4b92-b9dc-16064320e4c7 req-b72126c4-d5da-4dfa-a191-d56f3deaad87 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:55.556267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-198a69a6-736a-4b92-b9dc-16064320e4c7 req-b72126c4-d5da-4dfa-a191-d56f3deaad87 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.582510 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-198a69a6-736a-4b92-b9dc-16064320e4c7 req-b72126c4-d5da-4dfa-a191-d56f3deaad87 service nova] Creating event network-changed:576fc76a-50fd-4ff9-80cc-ee131fbb00c3 for instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 on hv-cinder-84773 Sep 06 20:15:55.592975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-198a69a6-736a-4b92-b9dc-16064320e4c7 req-b72126c4-d5da-4dfa-a191-d56f3deaad87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068638 Sep 06 20:15:55.594887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 20/43] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:15:55.609686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:55.615519 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:55.617603 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:55.624650 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7ee6f15d-2b52-4463-956b-d8ca187c590a tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 1.048661 Sep 06 20:15:55.626485 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 24/44] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:54 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:15:55.629202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:55.630051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:55.630775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.631969 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:55.632841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:55.633545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.636010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:55.637051 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:55.656278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:55.657229 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:55.658109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.659532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:55.661226 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:55.662308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.751498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:55.760893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:55.762502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:55.764062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3c999528-09b5-4754-ad3b-33e74639ab23 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1334 microversion: 2.20 time: 0.135858 Sep 06 20:15:55.765002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 25/45] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:15:55 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:15:55.770213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:55.770845 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:55.778060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:55.778560 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:55.779029 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.779765 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:55.780271 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:55.780664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:55.830820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:55.840558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a0b61860-b84e-4c1b-aac0-b24d6b630bb1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.241892 Sep 06 20:15:55.841174 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 21/46] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:55 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:55.938300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:55.947421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b156c553-3050-4185-93db-56a47060a389 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.181439 Sep 06 20:15:55.948135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 26/47] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:55 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:56.540611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:56.541853 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:56.556501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:56.557875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:56.558895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:56.560106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:56.560943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:56.561912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:56.781489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-de9b8fdb-304b-4d22-926f-ea314d516edb req-f46c6672-1d99-4061-8415-00be18c9374b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c", "name": "network-vif-plugged", "status": "completed", "tag": "03b06557-9c5e-4e13-9df1-1d7acac27bc0"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:15:56.797027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-de9b8fdb-304b-4d22-926f-ea314d516edb req-f46c6672-1d99-4061-8415-00be18c9374b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:56.797522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-de9b8fdb-304b-4d22-926f-ea314d516edb req-f46c6672-1d99-4061-8415-00be18c9374b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:56.797988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-de9b8fdb-304b-4d22-926f-ea314d516edb req-f46c6672-1d99-4061-8415-00be18c9374b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:56.813871 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-de9b8fdb-304b-4d22-926f-ea314d516edb req-f46c6672-1d99-4061-8415-00be18c9374b service nova] Creating event network-vif-plugged:03b06557-9c5e-4e13-9df1-1d7acac27bc0 for instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c on hv-cinder-84773 Sep 06 20:15:56.828081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-de9b8fdb-304b-4d22-926f-ea314d516edb req-f46c6672-1d99-4061-8415-00be18c9374b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205453 Sep 06 20:15:56.829506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 27/48] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:15:56.835728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:56.836961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:56.846787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:56.848127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:56.848889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:56.851067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:56.853318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:56.854489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:56.925191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=4 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:15:56.945049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:56.964326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7d98e088-9727-4329-9cd7-7fa4ce06ee28 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.429641 Sep 06 20:15:56.965195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 22/49] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:56 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:56.974619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:56.975882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:56.985086 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:56.985833 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:56.986671 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:56.987950 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:56.988912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:56.989834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:57.104595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:57.124278 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:57.127178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:57.130634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6bdd8dd0-e858-483a-94fc-eff426354e32 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1342 microversion: 2.20 time: 0.163341 Sep 06 20:15:57.131446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 23/50] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:15:56 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:15:57.153025 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:57.155527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:57.171176 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:57.172228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:57.173231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:57.174798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:57.176109 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:57.176848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:57.263435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:57.288344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-02882c58-5ce8-469a-857e-8ab7b9b67577 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.455556 Sep 06 20:15:57.293681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 28/51] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:56 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:57.300367 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:57.301938 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:57.313463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:57.318197 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:57.319136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:57.320072 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:57.322695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:57.324162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:57.480711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:57.498156 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-850e9307-b50e-416f-b372-55a3a60e29ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.364395 Sep 06 20:15:57.499574 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 24/52] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:57 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:57.563880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:57.588142 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5511a1ef-9784-4ede-b594-5187a87b08d2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.293722 Sep 06 20:15:57.589250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 29/53] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:57 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:58.001681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:58.003175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:58.017366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:58.018281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:58.018979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:58.020481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:58.024280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:58.025132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:58.181929 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:58.183306 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:58.197408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:58.198907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:58.203646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:58.204528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:58.205127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:58.206073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:58.695734 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:58.716995 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:58.724854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:58.734435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c3a5b519-f1d9-4aff-9c56-f9e7d1eb7261 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1352 microversion: 2.20 time: 0.553493 Sep 06 20:15:58.737494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 30/54] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:15:58 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1352 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:15:58.757530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:58.758591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:58.781252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:58.782243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:58.783155 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:58.784565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:58.796360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:58.797321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:59.599868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:59.626536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2e85f543-6c60-4ac8-9b32-df642f5971d4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 1.627445 Sep 06 20:15:59.628197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 25/55] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:57 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:15:59.655754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:59.657209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:59.704193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:59.704776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:59.705583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:59.714831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:59.718044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:59.719155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:59.894653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:15:59.916934 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3dc7e8ab-5367-41f4-bc53-27860abcd5b6 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 1.176183 Sep 06 20:15:59.919211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 31/56] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:58 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:15:59.930733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:15:59.932453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:15:59.955577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:59.957722 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:59.959355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:15:59.961311 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:15:59.962493 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:15:59.964274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.171671 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:00.225502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-29f0b453-fddd-45a6-89a0-f4dddfb1b98f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.593838 Sep 06 20:16:00.227755 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 26/57] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:59 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:00.241648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-1bad14af-b7b9-4b4f-8057-87855f64be22 req-9d3bf1c5-0808-416c-96af-ba623bb06e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195da2b-23fc-4ec2-8c0e-69babd249087", "name": "network-vif-plugged", "status": "completed", "tag": "339442d0-dfaf-4373-a89f-2acfe395baa1"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:00.272688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-1bad14af-b7b9-4b4f-8057-87855f64be22 req-9d3bf1c5-0808-416c-96af-ba623bb06e7a service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.274535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-1bad14af-b7b9-4b4f-8057-87855f64be22 req-9d3bf1c5-0808-416c-96af-ba623bb06e7a service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.276079 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-1bad14af-b7b9-4b4f-8057-87855f64be22 req-9d3bf1c5-0808-416c-96af-ba623bb06e7a service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.354905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-1bad14af-b7b9-4b4f-8057-87855f64be22 req-9d3bf1c5-0808-416c-96af-ba623bb06e7a service nova] Creating event network-vif-plugged:339442d0-dfaf-4373-a89f-2acfe395baa1 for instance 3195da2b-23fc-4ec2-8c0e-69babd249087 on hv-cinder-84773 Sep 06 20:16:00.376800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-1bad14af-b7b9-4b4f-8057-87855f64be22 req-9d3bf1c5-0808-416c-96af-ba623bb06e7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145406 Sep 06 20:16:00.384958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 27/58] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:00.400310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:00.402222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:00.403962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:00.420609 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.422750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.424124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.426241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.428086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-774b977c-cd50-4aac-bc49-2d71a71e8bf9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.506192 Sep 06 20:16:00.428621 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.429812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.445283 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:15:59 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:00.446558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:00.600638 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:00.620776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:00.622888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:00.624101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-521da7c1-ea71-4321-a228-d17560e9ce2f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1340 microversion: 2.20 time: 0.236926 Sep 06 20:16:00.640645 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 28/60] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:00 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1340 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:00.668180 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:00.670092 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:00.686044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.689394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.693212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.694913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.697879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.699035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.760387 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-3b83bb42-9208-436d-a825-0f92cf828db0 req-65f042d7-19b4-4730-b439-70fcec3edeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a69dcaa-e0c4-49b1-a7c4-74e4a5219936", "tag": "f366b771-f138-4234-b315-fb86387e043d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:00.777808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3b83bb42-9208-436d-a825-0f92cf828db0 req-65f042d7-19b4-4730-b439-70fcec3edeb3 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.783997 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3b83bb42-9208-436d-a825-0f92cf828db0 req-65f042d7-19b4-4730-b439-70fcec3edeb3 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.785331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3b83bb42-9208-436d-a825-0f92cf828db0 req-65f042d7-19b4-4730-b439-70fcec3edeb3 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.811967 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-3b83bb42-9208-436d-a825-0f92cf828db0 req-65f042d7-19b4-4730-b439-70fcec3edeb3 service nova] Creating event network-changed:f366b771-f138-4234-b315-fb86387e043d for instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 on hv-cinder-84773 Sep 06 20:16:00.825038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-3b83bb42-9208-436d-a825-0f92cf828db0 req-65f042d7-19b4-4730-b439-70fcec3edeb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067590 Sep 06 20:16:00.827071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 29/61] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:00.953284 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:00.954516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:00.967690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.968695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.969456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:00.970842 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:00.971729 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:00.972748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:01.238333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:01.240382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:01.279560 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8c9cf3f2-922a-4f38-972f-0a3c674a6bf9 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.334570 Sep 06 20:16:01.280628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 30/62] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:00 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:01.295654 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:01.296539 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:01.302798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8ed3374d-005a-4cb8-85bf-b31c7777cfe2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.645334 Sep 06 20:16:01.310908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:00 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:01.321824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:01.325406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:01.326592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:01.329738 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:01.331182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:01.332427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:01.484645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:01.486305 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:01.509730 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:01.510942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:01.511913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:01.513401 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:01.514548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:01.515582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:01.672810 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=6 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:01.730824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:01.750152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a7405f37-5854-433e-98f2-fe9191190359 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.466710 Sep 06 20:16:01.751527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 31/64] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:01 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:01.774978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:01.778191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:01.786889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:01.788052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:01.788794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:01.791875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:01.794458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:01.795275 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:01.932640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:01.976918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-526f9d6b-62b1-4cc7-b8d7-f1ad10e4142b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.498975 Sep 06 20:16:01.997686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:01 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:02.069242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:02.080588 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:02.084061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:02.086177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3ede7a84-279c-48a4-a230-5a891a95944f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.332193 Sep 06 20:16:02.086938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 32/66] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:01 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:02.373474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:02.374749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:02.376369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:02.376922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:02.391537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:02.392695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:02.395083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:02.396271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:02.397801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:02.399331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:02.399635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:02.400858 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:02.401999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:02.404161 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:02.405797 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:02.406885 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:02.609118 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=14 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:02.740467 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:02.760548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e51f11d9-8567-4ea1-84ca-408a09a0f0f0 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.394869 Sep 06 20:16:02.762912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 33/67] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:02 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:02.789245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:02.790703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:02.791505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:02.814300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-cf435fe9-97c9-449c-b7ff-90aa71a43fa7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.450555 Sep 06 20:16:02.821471 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:02 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:02.833990 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:02.834653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:02.835180 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:02.836299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:02.837096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:02.838094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:03.029487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:03.037551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:03.057948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:03.061843 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:03.071656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:03.084899 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:03.085919 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:03.086657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:03.675880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:03.688683 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8dcac5be-45c8-4e1c-a296-a72f2e2186a5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.913540 Sep 06 20:16:03.689696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:02 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:03.700087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:03.701975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:03.715648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:03.717422 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:03.718711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:03.722348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:03.723124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:03.723715 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:03.855381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:03.869315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e37d9cb4-696a-4d90-bb51-cf02cca2e5b1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.847257 Sep 06 20:16:03.893046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 36/70] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:03 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:03.907925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-9520acf6-9d95-42a3-a9f5-564bb1327039 req-2cc93ba1-5707-4753-a301-534c5b226e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62393da-6c69-4bac-8616-2d32da12ca1b", "name": "network-vif-plugged", "status": "completed", "tag": "19274d4d-c555-42bb-8fb2-8b7204647a39"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:03.931093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9520acf6-9d95-42a3-a9f5-564bb1327039 req-2cc93ba1-5707-4753-a301-534c5b226e5e service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:03.932418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9520acf6-9d95-42a3-a9f5-564bb1327039 req-2cc93ba1-5707-4753-a301-534c5b226e5e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:03.933318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9520acf6-9d95-42a3-a9f5-564bb1327039 req-2cc93ba1-5707-4753-a301-534c5b226e5e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:03.962764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-9520acf6-9d95-42a3-a9f5-564bb1327039 req-2cc93ba1-5707-4753-a301-534c5b226e5e service nova] Creating event network-vif-plugged:19274d4d-c555-42bb-8fb2-8b7204647a39 for instance a62393da-6c69-4bac-8616-2d32da12ca1b on hv-cinder-84773 Sep 06 20:16:03.972146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-9520acf6-9d95-42a3-a9f5-564bb1327039 req-2cc93ba1-5707-4753-a301-534c5b226e5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075557 Sep 06 20:16:03.973510 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 37/71] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:03.983636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:03.984580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:03.994564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:03.995354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:03.995869 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:03.996785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:03.997750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:03.998449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:04.049571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:04.067446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:04.072288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:04.076899 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d07fe912-accd-4ff8-8b60-15f89b494b50 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.384699 Sep 06 20:16:04.079956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 35/72] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:03 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:04.088388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:04.089690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:04.107396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:04.115921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:04.117174 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:04.119227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:04.120408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:04.121690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:04.402074 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:04.430502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a64c5632-4f00-49ec-be4f-97d81a7d5f02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.447286 Sep 06 20:16:04.442302 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 38/73] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:03 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:04.507191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:04.522649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5951c9f9-e8ec-4517-a371-25fdb126b360 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.438993 Sep 06 20:16:04.538008 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 36/74] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:04 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:04.727435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:04.728560 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:04.736204 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:04.737975 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:04.738809 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:04.739822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:04.740546 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:04.742056 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:04.898281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:04.898940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:04.908402 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:04.908921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:04.909503 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:04.910710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:04.911557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:04.912424 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.271921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:05.286798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0f3b5315-4c9b-44d5-acfe-16d7695d1953 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.563349 Sep 06 20:16:05.297225 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:05.298103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 39/75] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:04 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:05.311912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e1e97f59-9904-4b30-bacc-7a03eb0483bd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.419008 Sep 06 20:16:05.313538 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:05.316183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 37/76] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:04 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:05.324469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:05.349286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:05.353123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:05.354889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.357750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:05.359881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:05.360901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.498053 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:05.499410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:05.512347 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:05.513447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:05.514379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.521254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:05.522500 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:05.523423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.722998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:05.753480 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:05.756802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:05.759066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-494d8c98-990f-4dd0-92bc-ea7b5c5064f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.458347 Sep 06 20:16:05.760124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 40/77] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:05 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:05.769340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:05.770491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:05.784495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:05.785667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:05.786571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.788788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:05.791029 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:05.792126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.803955 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:05.833737 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:05.847787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ec1b6bfe-2f6c-4f64-95d0-ee5b6031ad3f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.354160 Sep 06 20:16:05.863336 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 38/78] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:05 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:05.876035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-e0d4cd3c-14f4-497f-a17a-dd79085da2b3 req-8a0a4996-68de-47ca-bced-34057301ee90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f6b5ee-95cf-4e73-8124-578bcbcd7c19", "tag": "9eaa793d-1594-4913-b5c0-8b0669ff04be"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:05.887841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e0d4cd3c-14f4-497f-a17a-dd79085da2b3 req-8a0a4996-68de-47ca-bced-34057301ee90 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:05.888310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e0d4cd3c-14f4-497f-a17a-dd79085da2b3 req-8a0a4996-68de-47ca-bced-34057301ee90 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:05.889067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e0d4cd3c-14f4-497f-a17a-dd79085da2b3 req-8a0a4996-68de-47ca-bced-34057301ee90 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:05.906026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-e0d4cd3c-14f4-497f-a17a-dd79085da2b3 req-8a0a4996-68de-47ca-bced-34057301ee90 service nova] Creating event network-changed:9eaa793d-1594-4913-b5c0-8b0669ff04be for instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 on hv-cinder-84773 Sep 06 20:16:05.912657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-e0d4cd3c-14f4-497f-a17a-dd79085da2b3 req-8a0a4996-68de-47ca-bced-34057301ee90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041825 Sep 06 20:16:05.914065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 39/79] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:06.031513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:06.048425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8886f80c-c17f-41f9-bc6c-4e0fdcf38ad6 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.286354 Sep 06 20:16:06.049381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 41/80] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:05 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:06.373116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:06.374743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:06.378148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:06.384267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:06.385414 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:06.387924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.388779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.389550 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.390799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.391409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.392116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.397823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.398891 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.399657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.400823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.401809 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.402329 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.594619 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:06.604437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-61fdeafe-03f2-471d-bc89-5ef7f8981ae8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.227125 Sep 06 20:16:06.605075 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 42/81] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:06 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:06.627003 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:06.637799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-17166a12-c96f-46a2-9825-2cd205717f1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.269410 Sep 06 20:16:06.638406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 40/82] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:06 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:06.793244 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:06.794262 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:06.801471 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.802054 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.802493 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.803232 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.803694 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.804127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.879695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:06.881725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:06.892065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.892936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.894732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.896034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:06.896896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:06.897675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:06.989788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:07.005562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:07.008666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:07.010838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c369b4e7-6a6a-487b-98cf-e663db10d1b7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.222258 Sep 06 20:16:07.011863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 43/83] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:06 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:07.077286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:07.086635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:07.086635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:07.087879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8ecb0dcd-3554-40c5-95ae-077369480182 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.216330 Sep 06 20:16:07.088686 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 41/84] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:06 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:07.094216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:07.094777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:07.095220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:07.095948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:07.096420 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:07.096899 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:07.287353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:07.297211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-063bb261-4fc1-4762-a9ff-f7bdae544e75 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.215654 Sep 06 20:16:07.298063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 44/85] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:07 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:07.630795 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:07.631632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:07.639967 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:07.640926 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:07.641925 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:07.643042 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:07.644616 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:07.645296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:07.668364 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:07.669866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:07.681252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:07.682413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:07.683325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:07.684547 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:07.685354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:07.686145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:07.880236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:07.896527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-61c2fd01-87c2-4a86-b4ff-9d20cfc07771 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.270353 Sep 06 20:16:07.897690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:07 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:07.960507 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:07.974368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-89860fce-e39f-489d-909a-649754a5f7b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.313184 Sep 06 20:16:07.975901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 45/87] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:07 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:08.043619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:08.044678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:08.053386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.054127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.054721 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:08.055669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.056227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.056700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:08.129064 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:08.130142 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:08.140865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.142108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.142978 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:08.144165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.145032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.145831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:08.241983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:08.256701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:08.258649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:08.260207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b5eadf8d-ab93-409e-9fcc-274dd86e9396 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.220996 Sep 06 20:16:08.261139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 43/88] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:08 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:16:08.335680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:08.336556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:08.345371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.346011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.346518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:08.347954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.348457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.348905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:08.351593 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:08.368454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9c23e1fc-c546-47ea-8273-14fb2f4fe5d3 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.246401 Sep 06 20:16:08.371107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 46/89] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:08 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:08.553072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:08.569868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5aa6128b-a3f8-4ae8-8cfb-baca612fcda2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.238170 Sep 06 20:16:08.571277 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 44/90] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:08 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:08.935574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:08.938811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:08.980327 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.981046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.981558 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:08.982642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:08.983381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:08.984037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.008305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:09.012375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:09.030479 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.030479 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.030479 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.031087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.031904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.032738 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.179887 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:09.192253 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6c8fc34a-8f1f-4771-bc84-14097b532523 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.272954 Sep 06 20:16:09.192937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 47/91] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:08 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:09.259333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:09.269084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0bada922-f59d-4b40-ae4d-509eeb28cdb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.270395 Sep 06 20:16:09.269768 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:08 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:09.290265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:09.291069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:09.299126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.300245 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.300773 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.301580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.302162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.302673 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.399935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:09.402722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:09.429344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.430623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.431724 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.433121 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.434103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.434668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.483735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:09.826586 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:09.836870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5f9f08d2-497f-47e1-8e50-28f456372768 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.443623 Sep 06 20:16:09.838408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 46/93] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:09 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:09.847922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:09.849242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:09.869999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.870553 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.872909 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:09.874031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:09.874620 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:09.875155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:10.122834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:10.130288 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:10.136790 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d9ec4757-26ae-493c-85de-1bc6aae80f05 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1322 microversion: 2.1 time: 0.296876 Sep 06 20:16:10.137897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 47/94] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:09 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:10.146562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:10.147469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-86610007", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "networks": [{"uuid": "d22406a4-171e-4b9a-8c7c-9069188f209c"}]}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:10.149526 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:10.151914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fde34405-d096-44c7-98ad-cf405870ae3f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.866717 Sep 06 20:16:10.153487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 48/95] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:09 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:10.225301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:10.226174 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:10.236596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:10.236879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] validate_networks() for [('d22406a4-171e-4b9a-8c7c-9069188f209c', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:16:10.238139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:10.238918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:10.240220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:10.241058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:10.241881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:10.438234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:10.477752 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e73f136c-3d62-4af2-92d1-86f1488ba588 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.262006 Sep 06 20:16:10.478746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 49/96] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:10 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:10.500375 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:10.501909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:10.530408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:10.532014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:10.532564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:10.533350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:10.533881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:10.534960 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.007229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:16:11.008666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:16:11.009521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:16:11.010555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:16:11.011477 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:16:11.029517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.030962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.032041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.033830 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.035139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.036326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.050090 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:11.065397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7b404daa-00a9-4278-808a-3453eb085c43 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.584572 Sep 06 20:16:11.067292 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 50/97] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:10 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:11.075929 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-0d36680a-33b6-45fd-be9f-829d67b18613 req-a24ecb7d-3147-4178-a523-8194acef9dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f25258-270e-479e-b6d2-5dc39da2f3a5", "name": "network-vif-plugged", "status": "completed", "tag": "576fc76a-50fd-4ff9-80cc-ee131fbb00c3"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:11.077223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Getting quotas for project 2ca4ba99b8a142d1aaf5ab9df178d981. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:16:11.085088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Getting quotas for user 861d88f0f5674b299575ad2e81dbaaf6 and project 2ca4ba99b8a142d1aaf5ab9df178d981. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:16:11.098104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-0d36680a-33b6-45fd-be9f-829d67b18613 req-a24ecb7d-3147-4178-a523-8194acef9dbd service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.099910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-0d36680a-33b6-45fd-be9f-829d67b18613 req-a24ecb7d-3147-4178-a523-8194acef9dbd service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.101073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-0d36680a-33b6-45fd-be9f-829d67b18613 req-a24ecb7d-3147-4178-a523-8194acef9dbd service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.114917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:16:11.120201 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:16:11.136509 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-0d36680a-33b6-45fd-be9f-829d67b18613 req-a24ecb7d-3147-4178-a523-8194acef9dbd service nova] Creating event network-vif-plugged:576fc76a-50fd-4ff9-80cc-ee131fbb00c3 for instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 on hv-cinder-84773 Sep 06 20:16:11.147537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-0d36680a-33b6-45fd-be9f-829d67b18613 req-a24ecb7d-3147-4178-a523-8194acef9dbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077572 Sep 06 20:16:11.151528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 51/98] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:11.164970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:11.166151 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:11.179440 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.179996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.180609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.181733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.182618 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.183636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.239657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1acc715c-2325-4cba-b78a-53550cb3bf01 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099192 Sep 06 20:16:11.243567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 48/99] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:16:11.266462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:11.268011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:11.286864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.287807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.288606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.290006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.291091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.292173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.583102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:11.600203 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3eb77163-d66e-465b-b596-d182e26a227f tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.445732 Sep 06 20:16:11.601271 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 52/100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:11 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:11.621052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:11.622812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:11.635621 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.636724 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.637897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.639569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.640804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.641908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.660456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:11.677091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f9dd0392-dbd6-4d2b-a8bb-9364182cd52a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1515 microversion: 2.1 time: 0.426906 Sep 06 20:16:11.689323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:11 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1515 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:11.697987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-50b7ffb8-4500-4e8d-8341-b51175ce732a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:11.699010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-50b7ffb8-4500-4e8d-8341-b51175ce732a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:11.781961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-50b7ffb8-4500-4e8d-8341-b51175ce732a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:11.796357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-50b7ffb8-4500-4e8d-8341-b51175ce732a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1212 microversion: 2.1 time: 0.115447 Sep 06 20:16:11.797540 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 50/102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:11 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1212 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:11.832794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:11.834099 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:11.852750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.853595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.854463 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.855855 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.856743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.857496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.921951 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:11.945150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:11.948359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:11.951036 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-65a3cdc4-bdaa-4d02-9ccc-59e77a3feb92 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.346729 Sep 06 20:16:11.954956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 53/103] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:11 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:11.962785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:11.968763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:11.984502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.985386 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.986331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:11.987602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:11.989450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:11.989450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.054108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:12.069255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b0c9fbc7-bc58-4b14-b848-87de8fdc7212 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.269706 Sep 06 20:16:12.070826 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 51/104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:11 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:12.105011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:12.105885 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:12.114506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.115173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.115578 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.116594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.117359 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.118145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.144341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lazy-loading 'flavor' on Instance uuid 3195da2b-23fc-4ec2-8c0e-69babd249087 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:16:12.298452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:12.316312 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ba636ddf-50b1-4278-aeb0-964a29d1c146 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.219403 Sep 06 20:16:12.318038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 52/105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:12 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:12.375262 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b3392017-beb7-47ee-b092-303f28acb14d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087/action" status: 200 len: 32 microversion: 2.1 time: 0.420579 Sep 06 20:16:12.376576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 54/106] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:16:11 2022] POST /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 20:16:12.389902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:12.390653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:12.398764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.399352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.399823 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.400575 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.401055 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.401978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.567032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:12.585498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2fc63c3e-0f14-4dbc-8977-dce661323c38 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.201704 Sep 06 20:16:12.586366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 53/107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:12 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:12.640367 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:12.642136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:12.654591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.655456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.656188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.657876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.658714 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.660011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.844192 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:12.845246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:12.853002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:12.854045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.854556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.854999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.855738 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:12.856199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:12.856701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:12.868163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b776540e-8fcd-40a9-bb1e-3811ab1ec619 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.235817 Sep 06 20:16:12.869578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 55/108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:12 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:12.949046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:12.958867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8ffc1b5a-e494-4f9d-9f91-1c3999d5bd51 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1216 microversion: 2.1 time: 0.120661 Sep 06 20:16:12.959491 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 54/109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:12 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1216 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:12.995223 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:12.995886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:13.003569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.004058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.004552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.005448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.006000 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.006473 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.042160 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:13.110913 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:13.111678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:13.128183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.128918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.130068 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.131434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.132305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.133047 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.246167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:13.256214 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:13.258425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:13.259970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4c8a161a-f3e0-4074-b719-77762de4c379 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.272820 Sep 06 20:16:13.260697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 56/110] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:12 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:13.355427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:13.360718 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:13.361725 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:13.369606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9b28f08f-e5e6-464c-b1cc-33496f609b72 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.262842 Sep 06 20:16:13.370734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 55/111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:13 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:13.372149 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.372522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.373683 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.374716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.375203 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.375754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.552622 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:13.569701 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e0cf0172-7abc-4010-a4be-b39a55969572 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.216645 Sep 06 20:16:13.570826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 57/112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:13 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:13.621757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:13.622424 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:13.630381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.630885 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.631333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.632636 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.633669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.633669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.800438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:13.810575 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-22760c9c-e6b1-4c9f-9272-afbb3af88b80 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.193136 Sep 06 20:16:13.811391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 56/113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:13 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:13.902120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:13.903004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:13.910796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.911430 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.912071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.912956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:13.913525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:13.914129 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:13.990506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:13.991096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:14.002160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.003119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.003889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.005157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.007656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.007656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.108766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:14.118285 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:14.119523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d44e02ca-bf69-4fb8-bd9e-b2a7bc3cd559 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.221669 Sep 06 20:16:14.120492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 58/114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:13 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:14.136120 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fb1992b9-bc4c-4388-8daf-9f43cca2ec3a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1216 microversion: 2.1 time: 0.153630 Sep 06 20:16:14.137218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 57/115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:13 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:14.288215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:14.290407 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:14.297913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.298340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.298818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.299912 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.300406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.300856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.405938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:14.407074 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:14.416282 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.416936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.418981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.418981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.418981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.419655 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.491037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:14.514264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:14.516343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:14.519371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ea846a89-ffd5-48f5-be89-fe03dbc39056 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.235752 Sep 06 20:16:14.520679 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 59/116] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:14 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:14.597296 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:14.598540 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:14.607107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.607643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.608125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.609141 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.609757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.610239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.664892 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:14.673711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-118ad7fd-ee5f-402c-b03a-bdfd0281f241 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.272161 Sep 06 20:16:14.676127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 58/117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:14 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:14.819690 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:14.833095 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1ea83691-2c1b-4165-9e28-70019434d022 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.240633 Sep 06 20:16:14.834169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 60/118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:14 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:14.840170 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:14.841334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:14.854790 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.855798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.856681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:14.858157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:14.859442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:14.860238 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.074091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:15.089548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4162d85f-69f7-4678-afc3-73e4a3f58479 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.256560 Sep 06 20:16:15.099504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 59/119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:14 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:15.163582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:15.165357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:15.167806 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:15.169026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:15.178219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.179564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.181047 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.184143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.185976 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.187174 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.188930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.189483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.190794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.191653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.192313 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.192828 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.320410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:15.337864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-28af4289-83e9-4995-a911-45c73a05705b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1216 microversion: 2.1 time: 0.176690 Sep 06 20:16:15.338971 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 60/120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:15 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1216 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:15.566692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:15.568591 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:15.585318 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.586694 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.588947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.590661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.591833 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.592907 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.641071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:15.666982 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c62243d9-eff6-4b9e-ac4b-bb00a3acc804 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1315 microversion: 2.1 time: 0.514815 Sep 06 20:16:15.669569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:15 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:15.704008 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:15.705945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:15.720565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:15.725405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.727150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.729597 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:15.731289 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:15.732568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:15.733909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.266956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:16.285174 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-510255e7-3532-48e9-b322-df1ae2e13639 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.586955 Sep 06 20:16:16.307875 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 62/122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:15 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:16.328837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:16.330000 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:16.341473 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.342785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.343545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.344835 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.345696 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.347106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.615726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:16.635498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:16.638578 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:16.641819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-71cf1516-c149-462b-af9a-93292b07f449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 1.087291 Sep 06 20:16:16.643258 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 61/123] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:15 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:16:16.657537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:16.659517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:16.673665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.675008 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.675801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.677080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.677836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.678818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.849975 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:16.859892 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f71800b2-e8c6-400c-865a-a4cefc69a367 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.550006 Sep 06 20:16:16.860397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 63/124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:16 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:16.866086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:16.866697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:16.876894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.878082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.879121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.880424 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.881279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.882346 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.916112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:16.932209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7b226089-cc55-4d21-b0fe-95df13ac7d12 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.286985 Sep 06 20:16:16.932935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 62/125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:16 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:16.938294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:16.939189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:16.946336 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.946850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.947349 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.948310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:16.948957 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:16.949486 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:16.994921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:17.003623 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2370a2d2-4734-4a33-8e02-954e61b7684a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1264 microversion: 2.1 time: 0.142095 Sep 06 20:16:17.004463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 64/126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:16 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:17.253237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:17.278456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-37e32c51-32a7-4544-bf57-e8acf09ee644 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1502 microversion: 2.1 time: 0.342969 Sep 06 20:16:17.280138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 63/127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:16 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1502 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:17.355772 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:17.359229 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:17.384876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:17.385764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:17.386538 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:17.387622 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:17.388229 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:17.388979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:17.683117 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:17.697915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:17.700143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:17.724992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:17.726487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ceb6f8d1-dc8a-4df9-ab6f-295667cb533f tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.383804 Sep 06 20:16:17.727912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:17.746420 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:17.747326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 65/128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:17 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:17.749035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:17.762831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:17.763741 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:17.811700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:17.896220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:17.897341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:17.921981 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:17.922841 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:17.924906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:17.926247 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:17.927110 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:17.934849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.258574 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:18.271385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:18.273271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:18.274779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b9df7005-e55d-4c80-823e-14e1ef1b991c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.588946 Sep 06 20:16:18.275374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 64/129] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:17 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:18.280703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:18.281405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:18.292255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:18.293423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:18.294379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.295558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:18.296443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:18.297290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.511737 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:18.524710 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6c2a2671-8a5b-4628-ac0f-4bf54d9a45e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.635984 Sep 06 20:16:18.525902 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 66/130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:17 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:18.531454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-af2e0c32-78c3-4068-b118-1c61df28553d req-f9ec81f4-0466-46d8-8dd0-554cf6318e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a69dcaa-e0c4-49b1-a7c4-74e4a5219936", "name": "network-vif-plugged", "status": "completed", "tag": "f366b771-f138-4234-b315-fb86387e043d"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:18.542947 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-af2e0c32-78c3-4068-b118-1c61df28553d req-f9ec81f4-0466-46d8-8dd0-554cf6318e44 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:18.543444 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-af2e0c32-78c3-4068-b118-1c61df28553d req-f9ec81f4-0466-46d8-8dd0-554cf6318e44 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:18.544136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-af2e0c32-78c3-4068-b118-1c61df28553d req-f9ec81f4-0466-46d8-8dd0-554cf6318e44 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.558417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-af2e0c32-78c3-4068-b118-1c61df28553d req-f9ec81f4-0466-46d8-8dd0-554cf6318e44 service nova] Creating event network-vif-plugged:f366b771-f138-4234-b315-fb86387e043d for instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 on hv-cinder-84773 Sep 06 20:16:18.564078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-af2e0c32-78c3-4068-b118-1c61df28553d req-f9ec81f4-0466-46d8-8dd0-554cf6318e44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036492 Sep 06 20:16:18.564832 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 67/131] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:18.574096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:18.574899 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:18.582245 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:18.582749 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:18.583232 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.583988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:18.584492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:18.584878 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.672867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:18.676709 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:18.687153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-301f924f-77fe-47b6-9fab-f1a363ebb0a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.410196 Sep 06 20:16:18.688138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 65/132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:18 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:18.690978 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-32f55703-ac82-4bb6-8579-69c0a84523b0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1264 microversion: 2.1 time: 0.120576 Sep 06 20:16:18.692027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 68/133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:18 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1264 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:18.778838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:18.779428 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:18.787443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:18.788096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:18.788621 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.789459 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:18.790002 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:18.790563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:18.967507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:18.977235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f4563d8c-ff14-4aae-a32d-5e091280c2ba tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.202692 Sep 06 20:16:18.977951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 66/134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:18 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:19.326049 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:19.326963 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:19.334986 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.335876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.336547 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.337501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.338167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.338712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.515268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:19.530065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:19.532903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:19.535052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a08ce778-3318-4e40-879c-38a704a68228 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.213014 Sep 06 20:16:19.536056 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 69/135] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:19 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:19.568958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:19.570303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:19.583778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.584592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.585387 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.586893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.587760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.588535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.719332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:19.720206 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:19.732589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.733432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.734339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.735693 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.737291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.737976 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.836143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:19.845377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-92edf5fd-2119-43f0-b28a-7229a0d77cdb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.285354 Sep 06 20:16:19.846254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:19 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:19.851856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:19.852541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:19.863828 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.864427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.865231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.866189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:19.866678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:19.867323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:19.981576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:19.989481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:19.994288 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c155e38c-9fb7-40df-8ac4-b237ab85c44f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.281348 Sep 06 20:16:19.995249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:19 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:20.001886 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9197ac04-6daa-42c9-950b-1ff4f280cf79 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1264 microversion: 2.1 time: 0.154295 Sep 06 20:16:20.002595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:19 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:20.015489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:20.016728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:20.027462 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:20.027983 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:20.028487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:20.029318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:20.030853 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:20.031240 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:20.244406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:20.260464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f2c8dc5c-840d-40ba-9a99-cd152541439b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.252964 Sep 06 20:16:20.261565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:20 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:20.579084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:20.579788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:20.587289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:20.587879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:20.588348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:20.589089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:20.589584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:20.590117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:20.776405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:20.786087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:20.787644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:20.788922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5c1262d3-ecdf-46a2-9c4f-226044c3acd2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.213911 Sep 06 20:16:20.789601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 69/140] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:20 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:16:20.876848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:20.877585 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:20.884746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:20.885399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:20.885809 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:20.886564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:20.887057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:20.887514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.031895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:21.033049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:21.040777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.041436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.042157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.043342 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.044144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.044662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.066410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:21.067635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:21.081496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3fc7325e-329f-442c-9f4b-73f806cebcf1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.208255 Sep 06 20:16:21.082727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 72/141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:20 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:21.091083 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:21.092125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:21.101198 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.101969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.102754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.103810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.104420 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.105025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.138334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:21.152362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6db795cb-ed61-464c-b2be-24319ab783ab tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1264 microversion: 2.1 time: 0.125892 Sep 06 20:16:21.153230 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 70/142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:21 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1264 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:21.288497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:21.293311 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:21.294566 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:21.301958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:21.306945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-269f3eb9-0429-4dff-8895-f720791d8ad0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.222441 Sep 06 20:16:21.308382 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.308850 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:21 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:21.309838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.310699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.312119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.312805 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.313634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.635641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:21.646364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-65dc5bf8-b778-45f7-bce5-9be0fbe4e8f0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1363 microversion: 2.1 time: 0.361615 Sep 06 20:16:21.647104 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 71/144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:21 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:21.821091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:21.822079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:21.834788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.835623 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.836710 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:21.838149 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:21.838915 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:21.839646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.133537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:22.136360 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:22.141468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=8 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:22.170265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.171566 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.172698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.175124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.176323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.177457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.413496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:22.427520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:22.430757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:22.433320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ee11ec41-80c6-4422-951d-5fa5db3e9505 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.620446 Sep 06 20:16:22.435076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 74/145] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:21 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:22.445958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:22.447487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:22.470157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.472748 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.474018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.475679 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.476682 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.477439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.563779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:22.579530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7a039943-a6d8-4853-b798-7450e36597ab tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.465794 Sep 06 20:16:22.580735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 72/146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:22 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:22.590038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:22.591269 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:22.594117 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:22.603052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.604011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.605018 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.606350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.607564 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.608182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-16ca2288-884f-469a-8a5a-3f2e682419dc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1272 microversion: 2.1 time: 0.170263 Sep 06 20:16:22.608416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.609824 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 75/147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:22 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:22.618816 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "babbf54d-87dc-43d3-944d-cff57837f314"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:22.623401 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:22.632722 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.633412 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.634004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.634865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.635536 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.636071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.877362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:22.893767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ce43bb9a-98d3-4512-bbc4-255ee3447e2d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.309540 Sep 06 20:16:22.907436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 73/148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:22 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:22.934288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:22.935426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:22.947656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.948864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.949511 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:22.950893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:22.952061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:22.953042 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:23.149137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:23.158138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6cc39bb4-5331-4c0a-a574-bee8c03e486e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1549 microversion: 2.1 time: 0.248944 Sep 06 20:16:23.159373 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 74/149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:22 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1549 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:23.184009 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:23.184652 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:23.193209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:23.193923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:23.194507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:23.195349 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:23.196071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:23.196569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:23.373928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-80460e3e-7524-48d6-ad7b-7d18e7fc0139 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194072 Sep 06 20:16:23.374669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:16:23 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:16:23.494046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:23.494784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:23.502045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:23.502968 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:23.503538 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:23.504409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:23.504929 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:23.505550 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:24.071616 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:24.087235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:24.090548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:24.092541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3aeecd82-6281-4422-a1f0-1ecdbfb86ff3 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.604074 Sep 06 20:16:24.094890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 76/151] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:23 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:16:24.115536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:24.116406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:24.128529 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:24.129822 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:24.130821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:24.132609 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:24.133726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:24.134659 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:25.060496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:25.073314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-23f4b198-7e66-4e06-99cd-fbfb14839c42 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.975945 Sep 06 20:16:25.074366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 77/152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:24 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:25.084399 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:25.085833 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:25.101573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:25.101972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:25.102570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:25.103910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:25.104894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:25.108567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:25.300079 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:25.332850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c82c3899-d85a-47e3-8c91-8249a2bd75be tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1282 microversion: 2.1 time: 0.256411 Sep 06 20:16:25.334146 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 78/153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:25 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:25.358016 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:25.360301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:25.391863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:25.393375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:25.394527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:25.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:25.397464 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:25.398891 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:25.926705 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-517befdc-1177-4329-95c6-3466795885a7 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "POST /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.315095 Sep 06 20:16:25.931928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 76/154] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:16:22 2022] POST /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b/os-volume_attachments => generated 194 bytes in 3321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:25.952131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:25.956272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:25.975642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:25.976862 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:25.977593 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:25.984627 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:25.985641 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:25.987171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:26.087344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:26.136187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bb33f11c-0136-4f73-b503-24f6e72fb737 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.798426 Sep 06 20:16:26.138067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 79/155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:25 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:26.152423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:26.153904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:26.168101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:26.169509 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:26.171612 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:26.173249 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:26.174467 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:26.175727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:26.394145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:26.409152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:26.414715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:26.417446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-77d829b3-3b0e-49c4-9ffd-aa084dc30d2c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.483354 Sep 06 20:16:26.418527 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 77/156] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:25 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:26.429132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:26.430965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:26.445268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:26.446217 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:26.447026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:26.448610 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:26.449465 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:26.450705 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:26.465414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:26.477157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1863a8bf-ef29-4b60-81c3-a492dc62f7c0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1368 microversion: 2.1 time: 0.337290 Sep 06 20:16:26.495952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 80/157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:26 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:26.637879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-1d28fac2-bedd-443d-82c8-acbd585f96ca req-775ddda7-74ec-40ba-867e-71a2c1218f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f25258-270e-479e-b6d2-5dc39da2f3a5", "tag": "576fc76a-50fd-4ff9-80cc-ee131fbb00c3"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:26.655994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-1d28fac2-bedd-443d-82c8-acbd585f96ca req-775ddda7-74ec-40ba-867e-71a2c1218f90 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:26.657012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-1d28fac2-bedd-443d-82c8-acbd585f96ca req-775ddda7-74ec-40ba-867e-71a2c1218f90 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:26.657735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-1d28fac2-bedd-443d-82c8-acbd585f96ca req-775ddda7-74ec-40ba-867e-71a2c1218f90 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:26.672631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-1d28fac2-bedd-443d-82c8-acbd585f96ca req-775ddda7-74ec-40ba-867e-71a2c1218f90 service nova] Creating event network-changed:576fc76a-50fd-4ff9-80cc-ee131fbb00c3 for instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 on hv-cinder-84773 Sep 06 20:16:26.680731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-1d28fac2-bedd-443d-82c8-acbd585f96ca req-775ddda7-74ec-40ba-867e-71a2c1218f90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047219 Sep 06 20:16:26.681428 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 81/158] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:26.741762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:26.750209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-16311886-a683-421e-866e-d9e1d0c72cf8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.329537 Sep 06 20:16:26.750849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 78/159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:26 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:27.171067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:27.178025 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:27.181920 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:27.204465 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:27.210529 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:27.211742 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:27.215262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:27.216692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:27.226009 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:27.254954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:27.453334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:27.456218 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:27.510098 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:27.511435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:27.512491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:27.514286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:27.515531 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:27.516632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.009914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:28.011929 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:28.024064 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:28.025744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:28.027085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ff187960-0038-49a2-97f4-52497e6043ef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.581751 Sep 06 20:16:28.027688 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 79/160] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:27 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:16:28.035986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2585f9d3-6cac-42ac-bca7-ebfe27c15498 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.874700 Sep 06 20:16:28.038208 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 82/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:27 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:28.043371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:28.044191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:28.048676 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:28.052276 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:28.063143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:28.063674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:28.064158 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.065026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:28.065554 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:28.066028 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.068525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:28.070222 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:28.074767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.077702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:28.079797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:28.081467 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.616800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:28.638812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:28.651541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fbc4de2f-4bf6-4ca3-adad-6ed9d9594596 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.601499 Sep 06 20:16:28.654267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ca1a8d08-e364-4c38-b195-5b331a5a1f55 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1558 microversion: 2.1 time: 0.615267 Sep 06 20:16:28.654823 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:28 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:28.654977 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 80/163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:28 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1558 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:28.718640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:28.719037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:28.729689 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-9d55d6ac-f653-4d62-8f39-eba14ded2227 req-da642fd8-e00b-4923-bcb8-c933fba6b301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f6b5ee-95cf-4e73-8124-578bcbcd7c19", "name": "network-vif-plugged", "status": "completed", "tag": "9eaa793d-1594-4913-b5c0-8b0669ff04be"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:28.737661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:28.743646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:28.744459 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.745866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:28.746766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:28.753651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.763649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-9d55d6ac-f653-4d62-8f39-eba14ded2227 req-da642fd8-e00b-4923-bcb8-c933fba6b301 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:28.764513 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-9d55d6ac-f653-4d62-8f39-eba14ded2227 req-da642fd8-e00b-4923-bcb8-c933fba6b301 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:28.765299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-9d55d6ac-f653-4d62-8f39-eba14ded2227 req-da642fd8-e00b-4923-bcb8-c933fba6b301 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:28.825776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-9d55d6ac-f653-4d62-8f39-eba14ded2227 req-da642fd8-e00b-4923-bcb8-c933fba6b301 service nova] Creating event network-vif-plugged:9eaa793d-1594-4913-b5c0-8b0669ff04be for instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 on hv-cinder-84773 Sep 06 20:16:28.836539 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-9d55d6ac-f653-4d62-8f39-eba14ded2227 req-da642fd8-e00b-4923-bcb8-c933fba6b301 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174187 Sep 06 20:16:28.847650 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 84/164] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:29.040065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8b38c226-7f95-4e77-9759-ad505d2cefa3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.324608 Sep 06 20:16:29.044789 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 81/165] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:16:28 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-interface => generated 285 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:16:29.136133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:29.137997 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:29.140629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:29.142730 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:29.176274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:29.182605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:29.186815 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:29.188580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:29.190637 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:29.197209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:29.198613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:29.199895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:29.201794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:29.203171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:29.214843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:29.216405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:29.814232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:29.826752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:29.829046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:29.830351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-204f014d-f25b-4690-ac05-8176868bb44d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.716184 Sep 06 20:16:29.846082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 85/166] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:29 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:29.846082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:29.846082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:29.847171 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:29.847877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:29.848687 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:29.849950 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:29.850667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:29.851685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:30.083430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:30.096513 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0304474f-5750-4eee-b6c5-84d668966bc4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.262758 Sep 06 20:16:30.097809 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 86/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:29 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:30.370863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:30.386092 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6ad08c36-0d09-4329-a62c-8343f2a20753 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 1.268049 Sep 06 20:16:30.387146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 82/168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:29 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:30.504763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-3fa8b2cd-9781-4ed3-bd62-1bbd9ea43e96 req-68b75a1c-e5ed-4818-9a23-f0e0c5844d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e8ec4b2-b5fd-4798-a644-3d26c029e880", "tag": "19efa213-7920-4c0a-8ac0-ff6aeadbe5a6"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:30.515535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3fa8b2cd-9781-4ed3-bd62-1bbd9ea43e96 req-68b75a1c-e5ed-4818-9a23-f0e0c5844d0e service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:30.516017 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3fa8b2cd-9781-4ed3-bd62-1bbd9ea43e96 req-68b75a1c-e5ed-4818-9a23-f0e0c5844d0e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:30.516441 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3fa8b2cd-9781-4ed3-bd62-1bbd9ea43e96 req-68b75a1c-e5ed-4818-9a23-f0e0c5844d0e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:30.531086 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-3fa8b2cd-9781-4ed3-bd62-1bbd9ea43e96 req-68b75a1c-e5ed-4818-9a23-f0e0c5844d0e service nova] Creating event network-changed:19efa213-7920-4c0a-8ac0-ff6aeadbe5a6 for instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 on hv-cinder-84773 Sep 06 20:16:30.536896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-3fa8b2cd-9781-4ed3-bd62-1bbd9ea43e96 req-68b75a1c-e5ed-4818-9a23-f0e0c5844d0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036036 Sep 06 20:16:30.537939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 87/169] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:30.886751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:30.887834 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:30.932334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:30.933594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:30.934712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:30.939998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:30.943720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:30.944877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:31.139535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:31.142281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:31.159598 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:31.161181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:31.162984 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:31.165019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:31.166568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:31.167751 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:31.474400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:31.484837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e01b968c-c571-458b-8690-839f47fd0177 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.354639 Sep 06 20:16:31.486377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 88/170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:31 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:31.491335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:31.492377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:31.501350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:31.503563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:31.505176 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:31.508043 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:31.509161 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:31.509912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:31.616463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:31.649937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:31.654553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:31.657361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-afaf1e0f-617b-4590-a56f-cfe06929b847 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1407 microversion: 2.20 time: 0.775867 Sep 06 20:16:31.660054 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 83/171] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:30 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1407 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:31.774354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:31.784192 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-45c4cbb5-d535-4121-a831-74fecbbac6f1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.296560 Sep 06 20:16:31.786723 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 89/172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:31 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:32.530306 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:32.531590 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:32.542728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:32.544906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:32.545687 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:32.546974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:32.547794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:32.549035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:32.559923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-980e0411-0df8-411e-b720-9898e3ed4fd9 req-e74b5977-6251-4b1b-92a3-583af03d4de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a69dcaa-e0c4-49b1-a7c4-74e4a5219936", "tag": "f366b771-f138-4234-b315-fb86387e043d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:32.575205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-980e0411-0df8-411e-b720-9898e3ed4fd9 req-e74b5977-6251-4b1b-92a3-583af03d4de8 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:32.576263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-980e0411-0df8-411e-b720-9898e3ed4fd9 req-e74b5977-6251-4b1b-92a3-583af03d4de8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:32.576939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-980e0411-0df8-411e-b720-9898e3ed4fd9 req-e74b5977-6251-4b1b-92a3-583af03d4de8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:32.591955 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-980e0411-0df8-411e-b720-9898e3ed4fd9 req-e74b5977-6251-4b1b-92a3-583af03d4de8 service nova] Creating event network-changed:f366b771-f138-4234-b315-fb86387e043d for instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 on hv-cinder-84773 Sep 06 20:16:32.599281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-980e0411-0df8-411e-b720-9898e3ed4fd9 req-e74b5977-6251-4b1b-92a3-583af03d4de8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044111 Sep 06 20:16:32.600469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 90/173] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:16:32.710431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:32.712154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:32.723115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:32.724106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:32.724749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:32.725689 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:32.726994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:32.728014 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:32.795629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:32.812568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e23dff2d-fd1c-4245-97ea-ed09a9933787 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.289272 Sep 06 20:16:32.813670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 84/174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:32 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:32.823715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:32.825038 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:32.851334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:32.853751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:32.854686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:32.860686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:32.861664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:32.862472 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:33.171488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:33.181061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-180ee1c8-ae52-4254-9f98-2a40d01933e8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.365895 Sep 06 20:16:33.193987 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 85/175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:32 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:33.388753 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:33.403808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:33.406551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:33.408780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c3e064bb-ebac-4baf-b548-4bd2ce1ee71e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1598 microversion: 2.20 time: 0.709657 Sep 06 20:16:33.410016 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 91/176] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:16:32 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1598 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:16:33.447343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:33.448251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:33.459497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:33.460566 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:33.461559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:33.462729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:33.463626 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:33.464370 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:33.591592 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-884e07a0-20b9-4759-913b-52866892c331 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151408 Sep 06 20:16:33.592729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 86/177] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 20:16:33 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:16:33.857565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:33.858728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:33.870327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:33.871111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:33.871807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:33.872838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:33.873945 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:33.874669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:34.207459 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:34.208395 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:34.225532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:34.226114 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:34.226553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:34.227273 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:34.227791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:34.228384 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:34.322332 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:34.340472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1fcc3ab7-81f5-40bc-b4ba-0e9434bbe450 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.488965 Sep 06 20:16:34.342562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 92/178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:33 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:34.472827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:34.487280 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a729ee5b-7c98-4c13-a243-057d3e9ecf7d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.285745 Sep 06 20:16:34.488208 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 87/179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:34 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:35.168572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-0f5ca325-9c6a-4339-b834-2e0eaf15650a req-b2df484e-a029-4890-a022-0d2de4a49d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f6b5ee-95cf-4e73-8124-578bcbcd7c19", "tag": "9eaa793d-1594-4913-b5c0-8b0669ff04be"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:35.179459 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0f5ca325-9c6a-4339-b834-2e0eaf15650a req-b2df484e-a029-4890-a022-0d2de4a49d62 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:35.180007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0f5ca325-9c6a-4339-b834-2e0eaf15650a req-b2df484e-a029-4890-a022-0d2de4a49d62 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:35.180767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0f5ca325-9c6a-4339-b834-2e0eaf15650a req-b2df484e-a029-4890-a022-0d2de4a49d62 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:35.221003 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-0f5ca325-9c6a-4339-b834-2e0eaf15650a req-b2df484e-a029-4890-a022-0d2de4a49d62 service nova] Creating event network-changed:9eaa793d-1594-4913-b5c0-8b0669ff04be for instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 on hv-cinder-84773 Sep 06 20:16:35.234035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-0f5ca325-9c6a-4339-b834-2e0eaf15650a req-b2df484e-a029-4890-a022-0d2de4a49d62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069964 Sep 06 20:16:35.235354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 93/180] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:35.385537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:35.386620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:35.394842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:35.395343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:35.395884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:35.396868 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:35.397286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:35.398194 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:35.529204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:35.537570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:35.550328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:35.551189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:35.552175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:35.553753 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:35.554917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:35.555682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:35.644990 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:35.661412 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ec3c1f21-532d-4f96-9e2c-47568f3ddeac tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.280639 Sep 06 20:16:35.669718 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 88/181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:35 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:35.840538 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:35.856717 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-334b36d6-7ab7-4f26-b114-6f469c0cdd5f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.335888 Sep 06 20:16:35.878355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 94/182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:35 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:36.701222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:36.702483 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:36.715440 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:36.716419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:36.717248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:36.718568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:36.719389 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:36.720169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:36.883641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:36.884595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:36.892274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:36.892778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:36.893206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:36.894236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:36.894862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:36.895470 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:36.944502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:36.956629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:36.967835 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d0d74fbb-56e3-403b-9429-8c6dc51bee68 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.274453 Sep 06 20:16:36.968928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 89/183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:36 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:37.118481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:37.143355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-04ec95a2-be3e-4b31-8239-47810e009b47 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.263025 Sep 06 20:16:37.156536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 95/184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:36 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:37.997648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:37.998904 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:38.009147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:38.009929 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:38.010464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:38.011504 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:38.012165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:38.013144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:38.186015 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:38.187453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:38.195166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:38.195719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:38.196607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:38.197404 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:38.198040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:38.198610 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:38.210849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:38.221175 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f70a8dcb-4b16-4787-aecf-650b7bedd3e0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.231147 Sep 06 20:16:38.222442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 90/185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:37 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:38.373189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:38.383494 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8585aadf-6ccb-4e78-b561-eace30b0b8d7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.202181 Sep 06 20:16:38.384198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 96/186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:38 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:39.266575 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:39.268379 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:39.280448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:39.281436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:39.282328 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:39.284895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:39.285831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:39.286597 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:39.421233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:39.422483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:39.434295 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:39.435825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:39.436647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:39.439037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:39.440299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:39.441029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:39.530634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:39.542818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ca5e42e8-206b-47c0-9873-f1153f737189 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.283859 Sep 06 20:16:39.543969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 91/187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:39 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:39.630830 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:39.648608 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-71d9e258-5c02-4a30-ac70-a339a8e4c1f9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.236139 Sep 06 20:16:39.649997 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 97/188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:39 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:40.572660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:40.573794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:40.584513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:40.585383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:40.586210 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:40.587456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:40.588300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:40.589060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:40.686703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:40.689401 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:40.700764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:40.702025 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:40.702777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:40.704078 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:40.704949 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:40.705710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:40.792150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:40.805105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-247e8eeb-03f1-4756-9e71-6b070aa0519a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.238194 Sep 06 20:16:40.806392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 92/189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:40 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:40.936336 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:40.951204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b85ee70e-10c8-4d57-963e-57ab8e96961b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.272488 Sep 06 20:16:40.954028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 98/190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:40 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:41.834142 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:41.835275 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:41.850096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:41.851376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:41.852391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:41.853867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:41.855091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:41.855978 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:41.992426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:41.993160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:42.003480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:42.003889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:42.011868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:42.013007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:42.014078 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:42.014517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:42.271926 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:42.286699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-864f8381-0308-4743-8117-6eab1b705e19 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.298525 Sep 06 20:16:42.287796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 99/191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:41 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:42.624151 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:42.638842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-392c7c05-2cfc-4d02-86aa-0f6569724b72 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.813720 Sep 06 20:16:42.640125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 93/192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:41 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:43.138721 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:43.143294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:43.162370 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.167301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.168236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.169009 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.170421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.170981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.215956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:16:43.255281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:43.326836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:43.328826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:43.359248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.360766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.366295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.369246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.371439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.372409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.393562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a9a3a570-685c-4748-89ec-faa383f1e8ae tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 204 len: 0 microversion: 2.1 time: 0.257952 Sep 06 20:16:43.396208 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 100/193] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:16:43 2022] DELETE /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:16:43.406905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:43.408188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:43.418693 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.419196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.419639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.420484 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.424986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.426406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.627497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:43.630649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:43.642713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-75293e92-8dd5-439d-a929-87b2d1567caf tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1554 microversion: 2.1 time: 0.240638 Sep 06 20:16:43.643453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 101/194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:43 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:43.646218 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4839f3fc-03a2-445f-a6d9-7482169d8df8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.319710 Sep 06 20:16:43.659120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 94/195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:43 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:43.672750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:43.672955 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:43.680044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.680630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.681129 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.682101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:43.682776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:43.683566 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:43.885326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:43.895072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4926edd7-2062-466e-9094-5ea77742be10 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.226977 Sep 06 20:16:43.895879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 102/196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:43 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:44.672678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:44.674330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:44.674944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:44.675589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:44.683405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:44.683994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:44.685044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:44.686239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:44.686741 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:44.687196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:44.688240 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:44.689215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:44.690070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:44.692315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:44.693164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:44.693985 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:44.854941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:44.863759 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2d5a520d-c9ae-448e-9558-f9d7cd7a3ab5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.196431 Sep 06 20:16:44.864348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 103/197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:44 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:44.931040 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:44.934206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:44.935271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:44.944123 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:44.945653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:44.946505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:44.948153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:44.948351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-66b5647b-6d3b-43d1-931d-da5aa83da95d tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1554 microversion: 2.1 time: 0.281500 Sep 06 20:16:44.949034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:44.949605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 95/198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:44 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1554 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:44.950386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:45.115344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:45.129992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a8e4448e-04e7-44fd-ab06-c75605205530 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.200088 Sep 06 20:16:45.130983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 104/199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:44 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:45.903016 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:45.903958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:45.906845 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=68 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:45.914520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:45.915137 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:45.915668 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:45.916568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:45.917202 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:45.917801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:45.999843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:46.002645 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:46.018517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:46.019714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:46.020512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:46.021851 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:46.022596 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:46.023640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:46.111193 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:46.159116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-872190d8-024b-4279-bf08-e444488696a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.260779 Sep 06 20:16:46.160068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 96/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:45 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:46.171899 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:46.172543 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:46.181553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:46.182188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:46.182886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:46.183660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:46.184561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:46.185000 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:46.372133 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:46.382708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0b42ea88-6c1f-4f60-a90c-9d91aa426551 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1554 microversion: 2.1 time: 0.397603 Sep 06 20:16:46.401696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 105/201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:45 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1554 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:46.454408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:46.463478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ed7c8635-a2c7-4b21-adc4-a4ba8e30e7a8 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.296133 Sep 06 20:16:46.464114 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 97/202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:46 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:47.185114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:47.185902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:47.192893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:47.193383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:47.193852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:47.194577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:47.195035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:47.195451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:47.368889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:47.385278 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f8dd7301-8611-443f-8105-26a959741eab tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.202389 Sep 06 20:16:47.387302 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 106/203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:47 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:47.420754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:47.421308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:47.435270 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:47.436152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:47.436883 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:47.438444 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:47.439840 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:47.440571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:47.494396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:47.495699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:47.507171 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:47.508143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:47.509107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:47.510640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:47.511964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:47.513115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:47.698647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:47.723165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c4b2dabb-9a26-4993-b43c-49220e5e91e8 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1554 microversion: 2.1 time: 0.309852 Sep 06 20:16:47.726210 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 98/204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:47 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1554 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:47.785005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:47.796542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-297cb4ca-eee6-474c-8a57-ef0584a392cd tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.310549 Sep 06 20:16:47.799103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 107/205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:47 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:48.413698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:48.414750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:48.421479 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:48.422159 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:48.422489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:48.424190 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:48.424645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:48.425066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:48.562172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-92674251-7749-48b0-aaed-83ca4836357a req-21e2d12c-1b41-4588-b58e-2dd9b13f8378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62393da-6c69-4bac-8616-2d32da12ca1b", "name": "network-vif-deleted", "tag": "19274d4d-c555-42bb-8fb2-8b7204647a39"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:48.590338 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-92674251-7749-48b0-aaed-83ca4836357a req-21e2d12c-1b41-4588-b58e-2dd9b13f8378 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:48.590774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-92674251-7749-48b0-aaed-83ca4836357a req-21e2d12c-1b41-4588-b58e-2dd9b13f8378 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:48.591221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-92674251-7749-48b0-aaed-83ca4836357a req-21e2d12c-1b41-4588-b58e-2dd9b13f8378 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:48.611545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-92674251-7749-48b0-aaed-83ca4836357a req-21e2d12c-1b41-4588-b58e-2dd9b13f8378 service nova] Creating event network-vif-deleted:19274d4d-c555-42bb-8fb2-8b7204647a39 for instance a62393da-6c69-4bac-8616-2d32da12ca1b on hv-cinder-84773 Sep 06 20:16:48.620665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-92674251-7749-48b0-aaed-83ca4836357a req-21e2d12c-1b41-4588-b58e-2dd9b13f8378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067030 Sep 06 20:16:48.627818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 108/206] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:48.715513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:48.731460 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-75ec10e4-5f64-4ebb-ab0a-bef590ae03ca tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.321924 Sep 06 20:16:48.732493 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 99/207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:48 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:48.765694 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:48.766477 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:48.775046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:48.775190 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:48.775753 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:48.776432 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:48.780399 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:48.781378 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:48.824256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:48.825136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:48.833827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:48.834619 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:48.835183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:48.835897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:48.836530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:48.837070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:48.894114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:48.908613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e7422039-9118-4905-86d5-37ee0084aee4 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1346 microversion: 2.1 time: 0.146090 Sep 06 20:16:48.910837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 109/208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:48 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:49.057264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:49.074583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2036478f-abad-4b3d-8d69-144c12a8ac25 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.254596 Sep 06 20:16:49.075859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 100/209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:48 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:49.773544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:49.774606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:49.785581 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:49.786439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:49.787165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:49.788457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:49.789279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:49.790069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:49.951794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:49.952702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:49.962946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:49.963566 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:49.964277 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:49.965097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:49.965964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:49.966754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:50.000719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:50.010154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d605ff96-f726-48f5-a5bf-a127f817bf35 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.244276 Sep 06 20:16:50.010753 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:49 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:50.029344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:50.030242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:50.031008 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:50.031804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lazy-loading 'fault' on Instance uuid a62393da-6c69-4bac-8616-2d32da12ca1b {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:16:50.131010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:50.133262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:50.144403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:50.145724 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:50.146584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:50.148199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:50.149116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:50.150114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:50.160642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48cca45629ef4e09aac4262616e2792f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3f88491a2ee4a03b15cb8c88a9aaf9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:50.195504 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c4184e91-041b-4d90-aa2e-626ae40dba48 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 200 len: 1351 microversion: 2.1 time: 0.248741 Sep 06 20:16:50.216012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 101/211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:49 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 1351 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:50.510083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:50.542135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d5418028-5838-4231-b9b1-1a10121b7039 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.418781 Sep 06 20:16:50.543926 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 111/212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:50 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:50.696221 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-b6d22748-2361-4c3b-888f-694036cefb21 req-3200cdd8-3bae-4d1c-a986-6da14203475f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8ec4b2-b5fd-4798-a644-3d26c029e880", "name": "network-vif-plugged", "status": "completed", "tag": "19efa213-7920-4c0a-8ac0-ff6aeadbe5a6"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:50.737242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b6d22748-2361-4c3b-888f-694036cefb21 req-3200cdd8-3bae-4d1c-a986-6da14203475f service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:50.738206 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b6d22748-2361-4c3b-888f-694036cefb21 req-3200cdd8-3bae-4d1c-a986-6da14203475f service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:50.747067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b6d22748-2361-4c3b-888f-694036cefb21 req-3200cdd8-3bae-4d1c-a986-6da14203475f service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:50.798568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-b6d22748-2361-4c3b-888f-694036cefb21 req-3200cdd8-3bae-4d1c-a986-6da14203475f service nova] Creating event network-vif-plugged:19efa213-7920-4c0a-8ac0-ff6aeadbe5a6 for instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 on hv-cinder-84773 Sep 06 20:16:50.807869 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-b6d22748-2361-4c3b-888f-694036cefb21 req-3200cdd8-3bae-4d1c-a986-6da14203475f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118454 Sep 06 20:16:50.809638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 102/213] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:16:51.043122 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:51.044216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:51.056701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.058012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.059055 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:51.061074 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.062221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.063199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:51.255187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:51.255921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:51.257211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:51.267348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.268157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.268754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:51.269910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.270897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.271385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:51.280274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f7a1a8cb-e84f-4812-938b-bb2b4ab15ef3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.243765 Sep 06 20:16:51.288627 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] HTTP exception thrown: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Request method failure captured: Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b HTTP/1.1 Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pfrCj605zw75tix8SDi2Xafb-a-hN-ZgcuuIp4F96vg6-HFd6bQxvO7OV8Ks-bmpta8DSjS8sX3CZzl5sdBrUKK_DTdagjXZbCN5Fb0WWuNFXgsbKD3OujUi-Jaj91HbsrAgnKz-kh8e5jXUtfKt4L4wKYDa3-tyYAVT8a7mhomQY Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:16:51.294173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 48cca45629ef4e09aac4262616e2792f Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.295930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'a62393da-6c69-4bac-8616-2d32da12ca1b'} Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:16:51.296844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.298908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.300221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 112/214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:51 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:51.301413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Returning 404 to user: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:16:51.302512 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-aab8df9a-14fe-40e0-9c2b-9f6c3e74c473 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 404 len: 111 microversion: 2.1 time: 0.051745 Sep 06 20:16:51.307044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 103/215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:51 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 20:16:51.489757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:51.492426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:51.499102 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.499605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.500048 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:51.500779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.501308 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.501769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:51.518226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] HTTP exception thrown: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Request method failure captured: Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b/os-volume_attachments HTTP/1.1 Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pfrCj605zw75tix8SDi2Xafb-a-hN-ZgcuuIp4F96vg6-HFd6bQxvO7OV8Ks-bmpta8DSjS8sX3CZzl5sdBrUKK_DTdagjXZbCN5Fb0WWuNFXgsbKD3OujUi-Jaj91HbsrAgnKz-kh8e5jXUtfKt4L4wKYDa3-tyYAVT8a7mhomQY Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:16:51.523746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 48cca45629ef4e09aac4262616e2792f Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.526403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'server_id': 'a62393da-6c69-4bac-8616-2d32da12ca1b'} Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:16:51.527930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:51.530261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:51.532749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Returning 404 to user: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:16:51.532749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-561c17e6-c639-4905-b3b7-621c9340c3ec tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040718 Sep 06 20:16:51.532749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 113/216] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:16:51 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:16:51.613229 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:51.614034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:51.628837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.629899 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.630872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:51.632779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:51.633912 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:51.634811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:52.207257 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:52.223476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0c8899b0-d831-4153-806a-3f058a0c766b tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1312 microversion: 2.1 time: 0.614332 Sep 06 20:16:52.238437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 104/217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:51 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1312 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:52.318344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:52.320365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:52.333648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:52.334641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:52.335697 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:52.337684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:52.338812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:52.339831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:52.555781 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:52.568554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f8622992-fa4b-4322-85a4-43edf07aae37 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.258489 Sep 06 20:16:52.568554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 114/218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:52 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:52.808712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:52.809582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:52.820135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:52.821022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:52.821860 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:52.823177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:52.824363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:52.825662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:52.855153 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] HTTP exception thrown: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Request method failure captured: Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b HTTP/1.1 Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pfrCj605zw75tix8SDi2Xafb-a-hN-ZgcuuIp4F96vg6-HFd6bQxvO7OV8Ks-bmpta8DSjS8sX3CZzl5sdBrUKK_DTdagjXZbCN5Fb0WWuNFXgsbKD3OujUi-Jaj91HbsrAgnKz-kh8e5jXUtfKt4L4wKYDa3-tyYAVT8a7mhomQY Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:16:52.856674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 48cca45629ef4e09aac4262616e2792f Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.858713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'a62393da-6c69-4bac-8616-2d32da12ca1b'} Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:16:52.860085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.862823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.865185 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Returning 404 to user: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:16:52.865185 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9364c799-dfd3-4335-a1dc-8ffb146391c5 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 404 len: 111 microversion: 2.1 time: 0.054827 Sep 06 20:16:52.865185 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 105/219] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:16:52 2022] DELETE /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:16:52.869734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:52.870501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] [instance: a62393da-6c69-4bac-8616-2d32da12ca1b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:52.877108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:52.877632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:52.878085 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:52.879071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:52.880078 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:52.880520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:52.897128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] HTTP exception thrown: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Request method failure captured: Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b HTTP/1.1 Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pfrCj605zw75tix8SDi2Xafb-a-hN-ZgcuuIp4F96vg6-HFd6bQxvO7OV8Ks-bmpta8DSjS8sX3CZzl5sdBrUKK_DTdagjXZbCN5Fb0WWuNFXgsbKD3OujUi-Jaj91HbsrAgnKz-kh8e5jXUtfKt4L4wKYDa3-tyYAVT8a7mhomQY Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:16:52.899898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d3f88491a2ee4a03b15cb8c88a9aaf9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: d3f88491a2ee4a03b15cb8c88a9aaf9b Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-DeleteServersTestJSON-1222601786 Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 48cca45629ef4e09aac4262616e2792f Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-DeleteServersTestJSON-1222601786-project Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.902571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'a62393da-6c69-4bac-8616-2d32da12ca1b'} Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:16:52.903959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. Sep 06 20:16:52.906140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:16:52.908195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] Returning 404 to user: Instance a62393da-6c69-4bac-8616-2d32da12ca1b could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:16:52.908195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c8668806-df15-4ef7-9d3d-edbff66f3e02 tempest-DeleteServersTestJSON-1222601786 tempest-DeleteServersTestJSON-1222601786-project] 10.222.0.20 "GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b" status: 404 len: 111 microversion: 2.1 time: 0.036962 Sep 06 20:16:52.908195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 115/220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:52 2022] GET /compute/v2.1/servers/a62393da-6c69-4bac-8616-2d32da12ca1b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 20:16:53.257266 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:53.258363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:53.268744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:53.269542 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:53.270535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:53.271961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:53.273202 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:53.275360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:53.596168 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:53.598524 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:53.609684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:53.611423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:53.612380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:53.614187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:53.614904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:53.615568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:53.688322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:53.710359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-96862997-f576-4287-a7a6-274b81c08465 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1495 microversion: 2.1 time: 0.457752 Sep 06 20:16:53.712636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 106/221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:53 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1495 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:53.819665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:53.830494 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2c340b35-070b-4de0-a2fc-7126a31fbd8f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.240782 Sep 06 20:16:53.831912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 116/222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:53 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:54.874637 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:54.875440 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:54.883420 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:54.884321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:54.884834 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:54.885742 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:54.886466 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:54.887121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:55.232505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:55.244035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3e3738e9-49e0-4dd5-8830-e6d7b8fe6c49 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.375098 Sep 06 20:16:55.245092 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 107/223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:54 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:56.270555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:56.271449 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:56.287360 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:56.287904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:56.288368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:56.291662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:56.292299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:56.292799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:56.647490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:56.649690 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:56.665566 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:56.666707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:56.667923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:56.669756 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:56.670868 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:56.672053 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:56.683132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:56.738854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:16:56.843249 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:56.855198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-92272c91-5ab8-4385-82dd-8480ed8e0748 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.589207 Sep 06 20:16:56.856665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 117/224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:56 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:57.074057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-962dba42-26c3-462d-8bc8-af1e5e66b99f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 204 len: 0 microversion: 2.1 time: 0.426835 Sep 06 20:16:57.074057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 108/225] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:16:56 2022] DELETE /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 20:16:57.085743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:57.091173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:57.122287 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:57.124720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:57.125273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:57.126670 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:57.128246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:57.129173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:57.170763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:57.431769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:57.467864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-80734dca-87f0-48cd-b61d-d505633546b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1501 microversion: 2.1 time: 0.390689 Sep 06 20:16:57.485742 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 118/226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:57 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:57.905170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:57.907689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:57.916498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:57.917007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:57.917537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:57.919667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:57.920368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:57.920975 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:58.201932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:58.226147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-179c6c47-14c4-475a-b281-a403505483d8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.324849 Sep 06 20:16:58.227427 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 109/227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:57 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:16:58.408516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-302124528", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "networks": [{"uuid": "8f99d2a5-aeb3-4a94-8d0f-224d189c20c0"}]}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:16:58.439141 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:16:58.514832 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:58.515457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:58.530488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:58.531662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:58.533290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:58.536139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:58.537529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:58.538127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] validate_networks() for [('8f99d2a5-aeb3-4a94-8d0f-224d189c20c0', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:16:58.538823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:58.757488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:58.767255 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-45faca84-3859-4641-9a8c-a3e7e838272c tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1501 microversion: 2.1 time: 0.258777 Sep 06 20:16:58.768425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 110/228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:58 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1501 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:59.265781 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:59.281662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:59.341044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:59.341881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:59.342611 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:59.343847 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:59.345185 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:59.351453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:59.827636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:16:59.845111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-854dc633-84ff-41c6-84b8-5708f99a7957 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.592094 Sep 06 20:16:59.858608 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 111/229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:59 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:16:59.871093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:16:59.872231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:16:59.882087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:59.882750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:59.883231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:16:59.884219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:16:59.884697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:16:59.885118 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:00.009105 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:17:00.010387 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:17:00.011307 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:17:00.014296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:17:00.015087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:17:00.033407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:00.034691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:00.035454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:00.036850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:00.037677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:00.038591 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:00.077031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Getting quotas for project b5de971d8037434fbaf3c5aa93729028. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:17:00.086214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Getting quotas for user 87f8cc79586f4cb79c962ede8342f580 and project b5de971d8037434fbaf3c5aa93729028. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:17:00.109521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:17:00.114378 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:17:00.203161 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d82aeeef-a658-4c1b-8831-d195d0f1d7a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802634 Sep 06 20:17:00.205097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 119/230] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:16:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:17:00.224523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-63882e76-22c9-45a2-b3ef-9fd6675de870 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:00.226816 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-63882e76-22c9-45a2-b3ef-9fd6675de870 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:00.353264 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-63882e76-22c9-45a2-b3ef-9fd6675de870 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:00.370315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-63882e76-22c9-45a2-b3ef-9fd6675de870 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1218 microversion: 2.1 time: 0.156259 Sep 06 20:17:00.371732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 120/231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:00 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:00.588031 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:00.607348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-49cf0be5-f86c-491d-8138-f564fcbfe1ca tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1501 microversion: 2.1 time: 0.746251 Sep 06 20:17:00.629729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 112/232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:16:59 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1501 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:00.866865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-4c3c6610-9ba2-47ca-8c1f-8ea168745f09 req-03da4217-cc97-46bd-bdcd-667f8d28b14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8ec4b2-b5fd-4798-a644-3d26c029e880", "name": "network-vif-deleted", "tag": "19efa213-7920-4c0a-8ac0-ff6aeadbe5a6"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:00.886819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-4c3c6610-9ba2-47ca-8c1f-8ea168745f09 req-03da4217-cc97-46bd-bdcd-667f8d28b14e service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:00.887726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-4c3c6610-9ba2-47ca-8c1f-8ea168745f09 req-03da4217-cc97-46bd-bdcd-667f8d28b14e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:00.888639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-4c3c6610-9ba2-47ca-8c1f-8ea168745f09 req-03da4217-cc97-46bd-bdcd-667f8d28b14e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:00.897563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:00.898740 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:00.904311 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-4c3c6610-9ba2-47ca-8c1f-8ea168745f09 req-03da4217-cc97-46bd-bdcd-667f8d28b14e service nova] Creating event network-vif-deleted:19efa213-7920-4c0a-8ac0-ff6aeadbe5a6 for instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 on hv-cinder-84773 Sep 06 20:17:00.910496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:00.912938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-4c3c6610-9ba2-47ca-8c1f-8ea168745f09 req-03da4217-cc97-46bd-bdcd-667f8d28b14e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050874 Sep 06 20:17:00.914741 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 121/233] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:00.914917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:00.916376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:00.922918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:00.924525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:00.926270 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:01.204694 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:01.217577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c00a2d18-9cf8-4e54-a2e4-ce9a419cdb42 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.336686 Sep 06 20:17:01.218981 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 113/234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:00 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:01.408058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:01.409355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:01.420020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:01.420914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:01.421619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:01.422936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:01.423733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:01.424523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:01.549082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:01.569965 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-eea45d12-61f6-478f-a5c8-1aa6d82f9ac4 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1222 microversion: 2.1 time: 0.165910 Sep 06 20:17:01.570128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 122/235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:01 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:01.642252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:01.644792 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:01.652997 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:01.653485 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:01.653961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:01.654799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:01.655128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:01.655545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:01.695136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:01.695825 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:01.696266 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:01.696717 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lazy-loading 'fault' on Instance uuid 8e8ec4b2-b5fd-4798-a644-3d26c029e880 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:17:01.765036 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:01.776312 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-50761e07-7c89-4075-bf28-cecff6881c7d tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1302 microversion: 2.1 time: 0.139206 Sep 06 20:17:01.777815 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 114/236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:01 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1302 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:02.254111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:02.255233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:02.271669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:02.272721 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:02.275111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:02.275111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:02.276497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:02.278023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:02.545035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:02.556446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7892de4a-a27a-4920-a092-a5989b47fc45 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1521 microversion: 2.1 time: 0.309895 Sep 06 20:17:02.557075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 123/237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:02 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:02.617853 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:02.622576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:02.634848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:02.635945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:02.637304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:02.653696 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:02.654727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:02.655480 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:02.776310 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:02.812603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1fbd8ae6-0e27-4e9b-8bea-b42f929c1cee tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1214 microversion: 2.1 time: 0.205188 Sep 06 20:17:02.815449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 115/238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:02 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:02.858165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:02.859247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:02.871873 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:02.873209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:02.874345 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:02.876263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:02.877133 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:02.877936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:02.940129 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:02.940894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:02.942173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:02.942974 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lazy-loading 'fault' on Instance uuid 8e8ec4b2-b5fd-4798-a644-3d26c029e880 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:17:03.042152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:03.054213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c8246f7a-d88c-4dd9-8f96-7e7889e58d22 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 200 len: 1302 microversion: 2.1 time: 0.203431 Sep 06 20:17:03.054943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 124/239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:02 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 1302 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:03.598057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:03.599315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:03.612201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:03.612927 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:03.613732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:03.615070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:03.615903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:03.616659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:03.858459 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:03.859916 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:03.870025 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:03.870721 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:03.871566 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:03.872991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:03.874205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:03.875401 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:03.896939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:03.914751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-413b0389-57f9-4b73-ae5e-515ca7354574 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1501 microversion: 2.1 time: 0.324369 Sep 06 20:17:03.925667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 116/240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:03 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1501 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:03.933018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-54a8e155-ee3c-4833-b6bc-d6ea024448e3 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c3bb798b0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:03.981558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:04.003897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a7e6f05c-89ad-45e7-b3e8-5eaeb4d515de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1270 microversion: 2.1 time: 0.150541 Sep 06 20:17:04.004524 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 125/241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:03 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:04.010250 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:04.011206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:04.021203 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:04.021909 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:04.022466 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:04.023466 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:04.024005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:04.024452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:04.032413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-54a8e155-ee3c-4833-b6bc-d6ea024448e3 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/999808c8-04c9-4b89-b546-f9aad0f4b788" status: 200 len: 351 microversion: 2.1 time: 0.104496 Sep 06 20:17:04.033341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 117/242] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:17:03 2022] GET /compute/v2.1/os-volumes/999808c8-04c9-4b89-b546-f9aad0f4b788 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:17:04.080700 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:04.081315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 8e8ec4b2-b5fd-4798-a644-3d26c029e880] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:04.088210 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:04.088715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:04.089157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:04.090113 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:04.090669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:04.091102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:04.111721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] HTTP exception thrown: Instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 could not be found. Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Request method failure captured: Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 HTTP/1.1 Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6qFqXLdeZkg4cmf7D_omOZcC9hnHUu5sAQct5hJpCeX3lcDI9wGT9MSiA2ybACcAbUVPq36IKxWGFwk-7w2xNdYT8nORlXn45-pN7H2MH_O9nKrn7NF7OEGo4PDmfY7W2yqWFeu8SLKKuK3YLv315WPle72g1tmKgcF0BW5kFD2LNY Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 2ca4ba99b8a142d1aaf5ab9df178d981 Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-VolumesActionsTest-895586382 Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:17:04.113791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-VolumesActionsTest-895586382 Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 2ca4ba99b8a142d1aaf5ab9df178d981 Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-VolumesActionsTest-895586382 Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-VolumesActionsTest-895586382-project Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 861d88f0f5674b299575ad2e81dbaaf6 Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-VolumesActionsTest-895586382-project Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 could not be found. Sep 06 20:17:04.115950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '8e8ec4b2-b5fd-4798-a644-3d26c029e880'} Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 could not be found. Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:17:04.117348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 could not be found. Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 could not be found. Sep 06 20:17:04.120576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:04.121645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Returning 404 to user: Instance 8e8ec4b2-b5fd-4798-a644-3d26c029e880 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:17:04.121645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3ac7c232-3975-44a4-92a5-e09e565f7bce tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880" status: 404 len: 111 microversion: 2.1 time: 0.040000 Sep 06 20:17:04.121645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 118/243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:04 2022] GET /compute/v2.1/servers/8e8ec4b2-b5fd-4798-a644-3d26c029e880 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 20:17:04.231940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:04.249792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-afe22f59-e44f-428b-bdba-ba93496097e5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1515 microversion: 2.1 time: 0.244021 Sep 06 20:17:04.250879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 126/244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:04 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:04.316523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-24323989", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "networks": [{"uuid": "d22406a4-171e-4b9a-8c7c-9069188f209c"}]}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:04.416436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] validate_networks() for [('d22406a4-171e-4b9a-8c7c-9069188f209c', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:17:05.035421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:05.036827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:05.048934 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:05.049800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:05.050570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:05.051820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:05.052649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:05.053396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:05.160335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:05.176647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b745196c-33af-40e5-bde7-395425be8b5b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1276 microversion: 2.1 time: 0.149722 Sep 06 20:17:05.178093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 127/245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:05 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:05.393315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:17:05.394109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:17:05.394447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:17:05.395189 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:17:05.395950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:17:05.413478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:05.414164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:05.414702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:05.415592 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:05.416235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:05.416924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:05.442686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Getting quotas for project 2ca4ba99b8a142d1aaf5ab9df178d981. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:17:05.450025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Getting quotas for user 861d88f0f5674b299575ad2e81dbaaf6 and project 2ca4ba99b8a142d1aaf5ab9df178d981. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:17:05.468391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:17:05.471600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:17:05.549106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-889488f7-cf33-43d5-9a1a-0b32af5f85f4 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239042 Sep 06 20:17:05.550409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 119/246] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:17:05.572892 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db8b8d3d-136a-43d5-8854-419632af9f2a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:05.574802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-db8b8d3d-136a-43d5-8854-419632af9f2a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:05.685714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db8b8d3d-136a-43d5-8854-419632af9f2a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:05.702876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-db8b8d3d-136a-43d5-8854-419632af9f2a tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1212 microversion: 2.1 time: 0.143374 Sep 06 20:17:05.706225 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 128/247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:05 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1212 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:05.796385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-881f258e-b73d-45b6-bf44-cb994899a1c6 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c3bc971f0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:05.895101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-881f258e-b73d-45b6-bf44-cb994899a1c6 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c3c74776-e4ee-49cb-b97b-b9c4b2df13ad" status: 200 len: 350 microversion: 2.1 time: 0.103775 Sep 06 20:17:05.909652 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 120/248] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:17:05 2022] GET /compute/v2.1/os-volumes/c3c74776-e4ee-49cb-b97b-b9c4b2df13ad => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:06.114629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:06.119803 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:06.132517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.133844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.135138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:06.136932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.138040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.139063 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:06.208892 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:06.212562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:06.215513 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lazy-loading 'flavor' on Instance uuid 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:17:06.244529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.245396 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.246493 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:06.250493 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.254464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.255775 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:06.568250 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-745005fa-ae39-4cbc-844d-9a88fe1361a4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c/action" status: 200 len: 32 microversion: 2.1 time: 0.451486 Sep 06 20:17:06.569445 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 129/249] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:17:06 2022] POST /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 20:17:06.598357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:06.600100 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:06.612840 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.614096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.615154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:06.616746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.617557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.618462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:06.916980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:06.923812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:06.940058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c123c773-0417-4cb8-a254-20de6f94080f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.741066 Sep 06 20:17:06.940414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-85709286-1b48-40e5-9d79-5d70791a93ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.352962 Sep 06 20:17:06.941747 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 130/250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:06 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:06.954859 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:06.955022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 121/251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:06 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:06.959672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:06.975594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.976290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.976850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:06.977720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:06.978282 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:06.978798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:07.070521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:07.087142 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-57a61293-360d-4436-882f-a0034044ff9f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1208 microversion: 2.1 time: 0.143903 Sep 06 20:17:07.088645 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 131/252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:06 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:07.715629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-35a4fe5a-a77f-47e1-8e70-618ef0326cc6 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c3bb79af0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:07.776040 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-35a4fe5a-a77f-47e1-8e70-618ef0326cc6 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f8095271-0dd4-4cf7-b71d-26c1cdd4a58f" status: 200 len: 350 microversion: 2.1 time: 0.064811 Sep 06 20:17:07.783733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 122/253] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:17:07 2022] GET /compute/v2.1/os-volumes/f8095271-0dd4-4cf7-b71d-26c1cdd4a58f => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:07.790354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-663e0aa0-0591-42b5-bb52-2ad872d5b4c6 req-f0a250e1-7b71-40e1-8094-83d7c46e3549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a830e29c-1ec8-4c0d-b5e6-1221c54c8953", "tag": "28379454-0bd6-4566-88f1-908dde2c0b81"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:07.796796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-824befd4-356d-43b8-86f1-0d4d3f980989 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c3bcded30>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:07.813522 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-663e0aa0-0591-42b5-bb52-2ad872d5b4c6 req-f0a250e1-7b71-40e1-8094-83d7c46e3549 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:07.814826 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-663e0aa0-0591-42b5-bb52-2ad872d5b4c6 req-f0a250e1-7b71-40e1-8094-83d7c46e3549 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:07.815497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-663e0aa0-0591-42b5-bb52-2ad872d5b4c6 req-f0a250e1-7b71-40e1-8094-83d7c46e3549 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:07.840529 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-663e0aa0-0591-42b5-bb52-2ad872d5b4c6 req-f0a250e1-7b71-40e1-8094-83d7c46e3549 service nova] Creating event network-changed:28379454-0bd6-4566-88f1-908dde2c0b81 for instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 on hv-cinder-84773 Sep 06 20:17:07.855661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-663e0aa0-0591-42b5-bb52-2ad872d5b4c6 req-f0a250e1-7b71-40e1-8094-83d7c46e3549 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069905 Sep 06 20:17:07.856477 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 132/254] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:07.910643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-824befd4-356d-43b8-86f1-0d4d3f980989 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.117748 Sep 06 20:17:07.911253 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 123/255] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 20:17:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:07.930307 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1b7d2255-d2d6-45dc-9c78-3efe8adfcf81 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c37c4e0d0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:07.986335 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:07.986335 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:07.992854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:07.993422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:07.993983 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:07.994721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:07.995188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:07.995637 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:08.118109 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1b7d2255-d2d6-45dc-9c78-3efe8adfcf81 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.191647 Sep 06 20:17:08.119718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 133/256] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 6 20:17:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:08.155269 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:08.162368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:08.182908 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:08.184280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:08.185072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:08.186237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:08.189239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:08.190273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:08.596404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:08.606265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:08.616521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-19d30579-9ca4-4143-ba23-e3600b8f4d76 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.494749 Sep 06 20:17:08.617461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a42227c5-fb97-4c46-8140-1280becca82a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.639855 Sep 06 20:17:08.617985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 134/257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:08 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:08.619353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 124/258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:07 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:08.629349 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a390ea75-8052-4b23-8f3c-b597ffe7de1d tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c3bc97ca0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:08.635795 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:08.636970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:08.653019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:08.654303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:08.654952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:08.656026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:08.656796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:08.657704 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:08.767975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:08.784939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d3dda818-f7f1-4ad9-b89c-5197dcf92244 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1270 microversion: 2.1 time: 0.165001 Sep 06 20:17:08.786104 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 135/259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:08 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:08.806689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a390ea75-8052-4b23-8f3c-b597ffe7de1d tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.184751 Sep 06 20:17:08.807951 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 125/260] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 6 20:17:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:08.832285 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-49b12c09-e97b-4f33-95af-81f8f068e066 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c37b8d310>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:09.010268 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-49b12c09-e97b-4f33-95af-81f8f068e066 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.184515 Sep 06 20:17:09.011119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 136/261] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 6 20:17:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:09.028415 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c82bffd2-d47f-410c-a4a6-b31e515a07b4 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c3bb79dc0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:09.144021 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c82bffd2-d47f-410c-a4a6-b31e515a07b4 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.121228 Sep 06 20:17:09.145184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 126/262] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 6 20:17:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:09.162871 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3e7a5aed-047a-46b6-9c3d-29714c4a8538 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c37b99e50>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:09.265132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3e7a5aed-047a-46b6-9c3d-29714c4a8538 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.107616 Sep 06 20:17:09.266535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 137/263] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 20:17:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:09.288191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e23afb0e-613b-43c4-b7e6-7c1f7f6f81a5 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c3bcdea60>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:09.590248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e23afb0e-613b-43c4-b7e6-7c1f7f6f81a5 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.311931 Sep 06 20:17:09.591166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 127/264] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Sep 6 20:17:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:09.614580 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-399009fe-2ae9-4483-ad04-0a75e1806006 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] Calling method '.version_select at 0x7f9c37b894c0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:09.644843 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:09.645545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:09.661765 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:09.662652 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:09.663399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:09.664684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:09.665813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:09.666664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:09.836748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-399009fe-2ae9-4483-ad04-0a75e1806006 tempest-VolumesTestJSON-1775177725 tempest-VolumesTestJSON-1775177725-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.228370 Sep 06 20:17:09.847228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 138/265] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 6 20:17:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:09.848940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:09.854309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:09.888761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:09.889675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:09.890860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:09.895625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:09.896890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:09.897701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:10.012489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:10.025119 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6abed8c7-8959-4798-913d-214129f9d113 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.385621 Sep 06 20:17:10.037732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 128/266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:09 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:10.037732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:10.037732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:10.039224 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:10.039979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:10.040424 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:10.041169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:10.041664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:10.042090 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:10.060188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:10.147384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:10.157524 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-15345bf6-1f80-40fc-b12f-d0bbbe76ad04 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.317202 Sep 06 20:17:10.158756 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 139/267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:09 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:10.238538 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:10.250252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9be6a032-833a-47a6-9d11-0804a17ead54 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.222862 Sep 06 20:17:10.251195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 129/268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:10 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:11.061242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:11.062069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:11.068867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:11.069363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:11.069848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:11.070566 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:11.071027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:11.071452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:11.202022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:11.202895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:11.212526 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:11.213361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:11.213900 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:11.215050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:11.216291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:11.216693 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:11.428363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:11.429377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:11.436561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:11.444635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-98646653-a94b-4caa-bc20-1cfb34afaba3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.247701 Sep 06 20:17:11.445794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 130/269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:11 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:11.452338 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:11.452959 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:11.462077 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:11.462810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:11.463635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:11.464675 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:11.465234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:11.465733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:11.481329 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6a350ecd-a93f-4543-bdcb-20265506380f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.423591 Sep 06 20:17:11.483053 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 140/270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:11 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:11.489252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:11.683132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:11.693377 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-22303b82-dbee-40db-9b1f-94707b5ad9e2 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.246419 Sep 06 20:17:11.698092 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 131/271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:11 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:12.298878 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-c88ac0b5-7373-42f7-b869-eeb25b2f55aa req-1ab4be6c-6151-43c8-ba17-82e5e1478553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060dffeb-46ed-4ffa-a9b4-9bb609db92ab", "tag": "972054cf-ed02-476c-999f-1f46664adeb5"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:12.318754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-c88ac0b5-7373-42f7-b869-eeb25b2f55aa req-1ab4be6c-6151-43c8-ba17-82e5e1478553 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:12.319707 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-c88ac0b5-7373-42f7-b869-eeb25b2f55aa req-1ab4be6c-6151-43c8-ba17-82e5e1478553 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:12.320379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-c88ac0b5-7373-42f7-b869-eeb25b2f55aa req-1ab4be6c-6151-43c8-ba17-82e5e1478553 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:12.336964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-c88ac0b5-7373-42f7-b869-eeb25b2f55aa req-1ab4be6c-6151-43c8-ba17-82e5e1478553 service nova] Creating event network-changed:972054cf-ed02-476c-999f-1f46664adeb5 for instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab on hv-cinder-84773 Sep 06 20:17:12.344972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-c88ac0b5-7373-42f7-b869-eeb25b2f55aa req-1ab4be6c-6151-43c8-ba17-82e5e1478553 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054562 Sep 06 20:17:12.346131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 141/272] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:12.490049 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:12.491032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:12.502321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:12.503166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:12.503971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:12.506745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:12.506745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:12.507417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:12.519194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:12.520265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:12.529450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:12.530455 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:12.531115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:12.532149 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:12.532862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:12.535505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:12.846514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:12.863254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fd7c68d3-0dc4-4e8b-acdf-c268bd365edf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.379930 Sep 06 20:17:12.865686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 132/273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:12 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:12.874771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:12.876822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:12.890935 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:12.891838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:12.892628 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:12.893888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:12.894831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:12.895394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:12.926035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:12.936404 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-26f92537-9abe-40dd-ab70-f09ae182cbb9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.423555 Sep 06 20:17:12.951118 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:12 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:13.511533 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:13.526931 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7ec8ff7a-1e82-4609-a69d-4614584b1afc tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.658986 Sep 06 20:17:13.527970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 133/275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:12 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:13.894985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:13.896057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:13.907465 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:13.908518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:13.909221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:13.910548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:13.911374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:13.912089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:13.967113 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:13.968533 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:13.981030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:13.982620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:13.983672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:13.986409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:13.987855 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:13.988845 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:14.167034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:14.192396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-07abb073-c270-4aab-b4d2-ea8fb0b06603 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.304906 Sep 06 20:17:14.206046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 143/276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:13 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:14.240299 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:14.248656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-89ee56e4-99d0-4d2c-b244-340acb9cde37 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.288613 Sep 06 20:17:14.249368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 134/277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:13 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:14.568972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:14.569607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:14.577153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:14.577918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:14.579026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:14.580780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:14.580780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:14.581327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:14.860504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:14.894226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-660efb33-b249-4ad7-b55e-bce0e90eb98f tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.332914 Sep 06 20:17:14.895685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 144/278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:14 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:15.068144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-48ee36de-7599-4606-8dca-6da6c1e07c49 req-b3a47643-fdf3-441f-b749-fd78d8b9296c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a830e29c-1ec8-4c0d-b5e6-1221c54c8953", "name": "network-vif-plugged", "status": "completed", "tag": "28379454-0bd6-4566-88f1-908dde2c0b81"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:15.091450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-48ee36de-7599-4606-8dca-6da6c1e07c49 req-b3a47643-fdf3-441f-b749-fd78d8b9296c service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:15.092596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-48ee36de-7599-4606-8dca-6da6c1e07c49 req-b3a47643-fdf3-441f-b749-fd78d8b9296c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:15.093898 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-48ee36de-7599-4606-8dca-6da6c1e07c49 req-b3a47643-fdf3-441f-b749-fd78d8b9296c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:15.115962 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-48ee36de-7599-4606-8dca-6da6c1e07c49 req-b3a47643-fdf3-441f-b749-fd78d8b9296c service nova] Creating event network-vif-plugged:28379454-0bd6-4566-88f1-908dde2c0b81 for instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 on hv-cinder-84773 Sep 06 20:17:15.123116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-48ee36de-7599-4606-8dca-6da6c1e07c49 req-b3a47643-fdf3-441f-b749-fd78d8b9296c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060498 Sep 06 20:17:15.124093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 135/279] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:17:15.219127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:15.220627 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:15.229270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:15.230117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:15.231128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:15.233174 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:15.233996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:15.234602 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:15.287888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:15.289699 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:15.304280 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:15.306202 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:15.307214 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:15.309076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:15.310616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:15.312038 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:15.428295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:15.462930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=6 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:15.671539 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:15.687663 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:15.702489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e61cc219-fbc6-4d37-8a8e-84f311a272de tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.430341 Sep 06 20:17:15.703516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=10 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:15.709178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9c954e89-adaa-420f-8b59-a99f62d4fdaf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.493275 Sep 06 20:17:15.710706 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 145/280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:15 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:15.721720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 136/281] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:15 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:15.935711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:15.936565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:15.944746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:15.945338 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:15.945828 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:15.946551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:15.947013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:15.947442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:16.156178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:16.173952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-33059543-b6c2-4e64-b09d-d5e01f041982 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.241722 Sep 06 20:17:16.175040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 146/282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:15 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:16.739173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:16.739901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:16.743692 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:16.752780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:16.755330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:16.756349 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:16.757552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:16.758352 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:16.759012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:16.760454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:16.761651 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:16.780151 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:16.781076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:16.781864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:16.783499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:16.784617 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:16.785631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:17.048753 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:17.062998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d9c4a68d-409c-4267-89e5-8392240f2cb0 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1318 microversion: 2.1 time: 0.312003 Sep 06 20:17:17.079057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 147/283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:16 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:17.117256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:17.133497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0a50a65e-a497-4732-9ac2-223b1dcdecfb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.399971 Sep 06 20:17:17.135052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 137/284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:16 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:17.200903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:17.202739 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:17.225010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:17.226183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:17.228383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:17.229784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:17.230819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:17.231520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:17.491103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:17.507672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-074fe0c3-d9a4-4261-973b-4438bcbbc7c0 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.311000 Sep 06 20:17:17.509230 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 148/285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:17 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:18.096594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:18.097760 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:18.105828 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:18.106559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:18.107202 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:18.108624 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:18.109464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:18.110320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:18.173264 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:18.174180 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:18.195698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:18.196428 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:18.197045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:18.199048 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:18.200193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:18.200977 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:18.360907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:18.378878 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1d4861b8-8b20-48ba-8a8f-a38efe957146 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1508 microversion: 2.1 time: 0.289440 Sep 06 20:17:18.379479 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 138/286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:18 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:18.423845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:18.441840 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0c6a209b-2829-4f84-b835-a48ea0672535 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.272409 Sep 06 20:17:18.454678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 149/287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:18 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:18.540110 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:18.540822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:18.549810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:18.550314 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:18.550767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:18.551475 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:18.551939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:18.552372 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:18.840729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:18.852491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-15eccd30-c528-40cd-bd3d-0d9ed42a16b3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.320715 Sep 06 20:17:18.874591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 139/288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:18 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:19.391506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-3a16e52a-93da-499e-827b-9f1ec94ba13c req-8360b58b-4e4b-4e9f-bc10-115983ff934b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060dffeb-46ed-4ffa-a9b4-9bb609db92ab", "name": "network-vif-plugged", "status": "completed", "tag": "972054cf-ed02-476c-999f-1f46664adeb5"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:19.435289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3a16e52a-93da-499e-827b-9f1ec94ba13c req-8360b58b-4e4b-4e9f-bc10-115983ff934b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:19.436525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3a16e52a-93da-499e-827b-9f1ec94ba13c req-8360b58b-4e4b-4e9f-bc10-115983ff934b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:19.439342 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3a16e52a-93da-499e-827b-9f1ec94ba13c req-8360b58b-4e4b-4e9f-bc10-115983ff934b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:19.460347 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-3a16e52a-93da-499e-827b-9f1ec94ba13c req-8360b58b-4e4b-4e9f-bc10-115983ff934b service nova] Creating event network-vif-plugged:972054cf-ed02-476c-999f-1f46664adeb5 for instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab on hv-cinder-84773 Sep 06 20:17:19.466904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-3a16e52a-93da-499e-827b-9f1ec94ba13c req-8360b58b-4e4b-4e9f-bc10-115983ff934b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086039 Sep 06 20:17:19.467938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 150/289] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:19.485313 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:19.486280 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:19.495952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:19.496824 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:19.497505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:19.498616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:19.499317 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:19.499744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:19.807880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:19.830508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1a4fcbea-8389-4595-af60-cf747b9135b5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.352657 Sep 06 20:17:19.835405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 140/290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:19 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:19.895291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:19.896422 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:19.908886 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:19.909658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:19.910305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:19.911461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:19.912348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:19.913184 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:20.234911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:20.247235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fa24acb8-0170-4264-bff7-1470d8065a03 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.362240 Sep 06 20:17:20.247932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 151/291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:19 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:20.868929 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:20.869768 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:20.883474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:20.884108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:20.884645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:20.885388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:20.885887 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:20.886540 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:21.279674 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:21.280807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:21.283095 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:21.292635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:21.293457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-379f3a2f-3312-484e-84e6-3c07e9d87a87 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.429533 Sep 06 20:17:21.293595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:21.294323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:21.294618 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 141/292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:20 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:21.296091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:21.298716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:21.299560 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:21.756981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:21.773905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-cfc5cb6d-7292-4059-8b2d-302cbda4d725 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1312 microversion: 2.1 time: 0.501832 Sep 06 20:17:21.780375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 152/293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:21 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1312 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:22.320895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:22.321681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:22.330358 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:22.330859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:22.331302 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:22.332081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:22.332671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:22.333459 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:22.559502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:22.578392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a46dc990-8380-49f5-aded-c00106fa0507 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.260324 Sep 06 20:17:22.585580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 142/294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:22 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:22.816683 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:22.819931 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:22.831776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:22.833641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:22.834456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:22.835805 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:22.836855 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:22.837388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:23.102072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:23.116293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2872c40e-96c6-4be8-9217-4326018888fa tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1495 microversion: 2.1 time: 0.310231 Sep 06 20:17:23.117265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 153/295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:22 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1495 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:23.623335 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:23.624418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:23.636490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:23.637332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:23.638371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:23.640351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:23.642178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:23.643218 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:23.958731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:23.974708 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b67001ad-f974-4d8c-a1d9-4a3dc76d772e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.359975 Sep 06 20:17:23.975915 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 143/296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:23 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:23.986698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:23.987609 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:23.998415 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:23.999668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:24.001229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:24.003148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:24.003941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:24.004660 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:24.277008 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7a12f038-071d-4364-bbce-139204e17d1d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/ips" status: 200 len: 146 microversion: 2.1 time: 0.295974 Sep 06 20:17:24.278423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 154/297] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:17:23 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/ips => generated 146 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:17:24.413519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:24.414401 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:24.425880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:24.426584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:24.427204 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:24.428464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:24.429195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:24.429985 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:24.473291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:17:24.616691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ee0a9acc-4c51-4b0f-84b8-be3165a65d63 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "DELETE /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 204 len: 0 microversion: 2.1 time: 0.207469 Sep 06 20:17:24.617866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 144/298] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:17:24 2022] DELETE /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:17:24.631740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:24.633211 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:24.644198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:24.645077 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:24.645888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:24.647283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:24.648315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:24.649037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:25.003960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:25.023843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-dac34a69-3720-4194-8296-6c92c8a0c346 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1501 microversion: 2.1 time: 0.395875 Sep 06 20:17:25.025797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 155/299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:24 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1501 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:25.042437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:25.046052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:25.060745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:25.062385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:25.064787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:25.067071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:25.070167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:25.071224 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:25.296624 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:25.312556 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-71f29b3a-812b-4ca0-beb8-9725a1678eda tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.293674 Sep 06 20:17:25.313728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 145/300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:25 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:26.068008 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:26.069848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:26.077273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:26.077829 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:26.078381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:26.079209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:26.079760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:26.080309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:26.281938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:26.294242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1f749c05-4c59-47eb-ad63-40c38058f634 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1501 microversion: 2.1 time: 0.232359 Sep 06 20:17:26.301909 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 156/301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:26 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:26.353749 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:26.355142 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:26.364684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:26.365401 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:26.366318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:26.367469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:26.368105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:26.368730 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:26.612411 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:26.619889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:26.633863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1c6e4602-c827-443c-9143-469d0b16ef89 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.285517 Sep 06 20:17:26.635032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 146/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:26 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:27.322431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:27.323582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:27.335172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:27.336068 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:27.336872 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:27.338231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:27.339103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:27.339953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:27.627702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:27.638539 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-595e6936-c4aa-4015-9e9c-808c54fe28d3 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1501 microversion: 2.1 time: 0.323291 Sep 06 20:17:27.639667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 157/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:27 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1501 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:27.680521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:27.682352 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:27.698246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:27.699122 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:27.699938 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:27.701209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:27.702072 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:27.702863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:27.879469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:27.888716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b15a003f-9433-4098-a1fd-be3056ad76ed tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.215600 Sep 06 20:17:27.902315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 147/304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:27 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:28.098557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-e9c97e95-b5c4-4cec-be64-961bdcb9cbec req-876f1d9d-3ec4-471b-819f-1cc51bd9fef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060dffeb-46ed-4ffa-a9b4-9bb609db92ab", "name": "network-vif-deleted", "tag": "972054cf-ed02-476c-999f-1f46664adeb5"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:28.117847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e9c97e95-b5c4-4cec-be64-961bdcb9cbec req-876f1d9d-3ec4-471b-819f-1cc51bd9fef8 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.121639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e9c97e95-b5c4-4cec-be64-961bdcb9cbec req-876f1d9d-3ec4-471b-819f-1cc51bd9fef8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.125498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e9c97e95-b5c4-4cec-be64-961bdcb9cbec req-876f1d9d-3ec4-471b-819f-1cc51bd9fef8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:28.159434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-e9c97e95-b5c4-4cec-be64-961bdcb9cbec req-876f1d9d-3ec4-471b-819f-1cc51bd9fef8 service nova] Creating event network-vif-deleted:972054cf-ed02-476c-999f-1f46664adeb5 for instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab on hv-cinder-84773 Sep 06 20:17:28.170837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-e9c97e95-b5c4-4cec-be64-961bdcb9cbec req-876f1d9d-3ec4-471b-819f-1cc51bd9fef8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080040 Sep 06 20:17:28.172416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 158/305] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:17:28.413381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:28.413926 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:28.424286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.424965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.425814 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:28.426697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.427468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.428045 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:28.459852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b726e2c4-c12e-4211-ba43-7514a014669c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/ips" status: 200 len: 150 microversion: 2.1 time: 0.050674 Sep 06 20:17:28.460558 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 148/306] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:17:28 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:28.677774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:28.678546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:28.680849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:28.687330 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.688436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.689072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:28.689884 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.690350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.690882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:28.752472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.753213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.753924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:28.754584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lazy-loading 'fault' on Instance uuid 060dffeb-46ed-4ffa-a9b4-9bb609db92ab {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:17:28.758681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:28.806666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861d88f0f5674b299575ad2e81dbaaf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca4ba99b8a142d1aaf5ab9df178d981', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:28.818882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b1156683-538a-41d9-bbd4-80d90f0d1365 tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 200 len: 1302 microversion: 2.1 time: 0.145970 Sep 06 20:17:28.819907 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 159/307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:28 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 1302 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:28.920521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:28.923489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:28.959889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.960395 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.960913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:28.961876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:28.962606 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:28.963084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:29.177073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:29.187285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d565fb6e-6bd5-4584-abac-77f8870900a5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.274719 Sep 06 20:17:29.188733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 149/308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:28 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:29.848123 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:29.849004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] [instance: 060dffeb-46ed-4ffa-a9b4-9bb609db92ab] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:29.859680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:29.860524 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:29.861331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:29.862508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:29.863277 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:29.864005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:29.887902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] HTTP exception thrown: Instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab could not be found. Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Request method failure captured: Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab HTTP/1.1 Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6qFqXLdeZkg4cmf7D_omOZcC9hnHUu5sAQct5hJpCeX3lcDI9wGT9MSiA2ybACcAbUVPq36IKxWGFwk-7w2xNdYT8nORlXn45-pN7H2MH_O9nKrn7NF7OEGo4PDmfY7W2yqWFeu8SLKKuK3YLv315WPle72g1tmKgcF0BW5kFD2LNY Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 2ca4ba99b8a142d1aaf5ab9df178d981 Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesActionsTest-895586382 Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:17:29.890978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca4ba99b8a142d1aaf5ab9df178d981"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesActionsTest-895586382 Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 2ca4ba99b8a142d1aaf5ab9df178d981 Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesActionsTest-895586382 Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesActionsTest-895586382-project Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 861d88f0f5674b299575ad2e81dbaaf6 Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesActionsTest-895586382-project Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab could not be found. Sep 06 20:17:29.893668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '060dffeb-46ed-4ffa-a9b4-9bb609db92ab'} Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab could not be found. Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:17:29.895371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab could not be found. Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab could not be found. Sep 06 20:17:29.899011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:17:29.901333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] Returning 404 to user: Instance 060dffeb-46ed-4ffa-a9b4-9bb609db92ab could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:17:29.901333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8b6548ac-b928-472e-98f9-5bd86448249e tempest-VolumesActionsTest-895586382 tempest-VolumesActionsTest-895586382-project] 10.222.0.20 "GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab" status: 404 len: 111 microversion: 2.1 time: 0.051442 Sep 06 20:17:29.901333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 160/309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:29 2022] GET /compute/v2.1/servers/060dffeb-46ed-4ffa-a9b4-9bb609db92ab => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:17:30.066609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "570e399a-30ee-4003-9836-fe8530edc8c7"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:30.069942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:30.079131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:30.079861 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:30.080355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:30.081191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:30.081771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:30.082207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:30.225212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:30.226026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:30.237652 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:30.238722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:30.239454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:30.240657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:30.241460 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:30.242261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:30.456362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:30.465644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4d8be78d-fbf8-4053-8733-284692535e82 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.248684 Sep 06 20:17:30.466234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 161/310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:30 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:30.699964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ca307d6-8273-4733-9313-61ed74065d57"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:30.702999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:30.710464 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:30.711110 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:30.711546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:30.712273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:30.712733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:30.713424 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:34.654065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6edec889-8788-4486-b444-099dcc05c087 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.958263 Sep 06 20:17:34.664523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d7272507-8fca-4778-95fa-71e2c3c640cf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.604509 Sep 06 20:17:34.665581 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 150/311] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:17:30 2022] POST /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 194 bytes in 4607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:17:34.669890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 162/312] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:17:30 2022] POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-volume_attachments => generated 194 bytes in 3975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:17:34.674566 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:34.675837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:34.684642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:34.685094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:34.685535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:34.686417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:34.686865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:34.687294 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:34.914495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:34.929732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-34234690-2246-4b28-ab3c-0d729e85802a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.262396 Sep 06 20:17:34.930755 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 151/313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:34 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:35.990308 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:35.991101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:36.002756 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:36.003342 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:36.003790 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:36.004582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:36.005071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:36.005577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:36.161966 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:36.175950 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f3e86176-1820-4661-8f2a-4fa685863231 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.208724 Sep 06 20:17:36.176864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 163/314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:35 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:37.208630 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:37.209357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:37.216865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:37.217357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:37.217833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:37.218561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:37.219377 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:37.220113 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:37.385911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:37.396504 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3e1882d1-a433-4d01-a8f9-00ce50c9d334 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.191998 Sep 06 20:17:37.397336 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 152/315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:37 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:38.423009 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:38.423666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:38.433641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:38.434423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:38.435016 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:38.436143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:38.436923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:38.438015 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:38.634384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:38.650200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-317ea66e-2430-4acb-b21b-f2b330551240 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.231306 Sep 06 20:17:38.657870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 164/316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:38 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:38.833473 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:38.834360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:38.846204 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:38.847019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:38.847769 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:38.849008 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:38.849855 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:38.850528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:38.899182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-304f482f-f640-465e-b1e3-46507cd85fe4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/ips" status: 200 len: 151 microversion: 2.20 time: 0.073054 Sep 06 20:17:38.900243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 153/317] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Sep 6 20:17:38 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:17:39.683797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:39.684873 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:39.693381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:39.694156 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:39.694735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:39.695974 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:39.696905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:39.697714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:39.957417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:39.972015 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d8a0729d-2086-44eb-8016-105778af84d2 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1501 microversion: 2.1 time: 0.292859 Sep 06 20:17:39.986123 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 165/318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:39 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1501 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:40.021183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4762641-b34d-4517-a919-a2143ed6fd62"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:40.025830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:40.053917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:40.054892 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:40.055912 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:40.057518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:40.058839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:40.059925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:40.110074 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] HTTP exception thrown: Cannot 'attach_volume' instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c while it is in vm_state rescued Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Request method failure captured: Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: POST /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c/os-volume_attachments HTTP/1.1 Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 74 Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pIzR1wGZoVZFCzLwuJtb60ZoHuW7x7VIRJBdTIgSLkhJ6MogAG81kphlJRWd2yzkQSH5VGRjxyve3vfCIJtUG5nSEMdNyhbgU5EgzTp213wFCnb7n7X7K58tvVQdM_JVlj8ckacBhgXuyLEUcNV8FfhX939pH7jINLvbt8aXN1D2o Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:17:40.114617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b005ff023a9f46fda3ceef605996c385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: ecde3e4bfd8b4f3490edd3832cea9e48 Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {"volumeAttachment": {"volumeId": "c4762641-b34d-4517-a919-a2143ed6fd62"}} Sep 06 20:17:40.117157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Cannot 'attach_volume' instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c while it is in vm_state rescued Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'server_id': '6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c', 'body': {'volumeAttachment': {'volumeId': 'c4762641-b34d-4517-a919-a2143ed6fd62'}}} Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:17:40.122013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c while it is in vm_state rescued Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:17:40.124274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:17:40.126677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:17:40.126677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:17:40.126677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c while it is in vm_state rescued Sep 06 20:17:40.126677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:17:40.126677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Returning 409 to user: Cannot 'attach_volume' instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c while it is in vm_state rescued {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:17:40.126677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-378a012b-da37-4646-8fc8-7764e6a745cb tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.107522 Sep 06 20:17:40.126677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 154/319] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:17:40 2022] POST /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c/os-volume_attachments => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 06 20:17:40.134332 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:40.135986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:40.149869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:40.150851 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:40.151839 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:40.153293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:40.155091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:40.156655 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:40.292748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-cac90d31-5eeb-4403-879e-4ee2d4bd2f7a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c/action" status: 202 len: 0 microversion: 2.1 time: 0.165207 Sep 06 20:17:40.294055 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 166/320] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:17:40 2022] POST /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:17:40.315144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:40.315144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:40.351700 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:40.352689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:40.353456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:40.355042 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:40.356138 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:40.357632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:40.570406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:40.586865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-df64dcc0-cc2f-4838-a8ae-c4a2c8f1f612 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1509 microversion: 2.1 time: 0.279564 Sep 06 20:17:40.602397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 155/321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:40 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:41.619299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:41.620470 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:41.637841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:41.638761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:41.640310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:41.641933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:41.642656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:41.643427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:41.871093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:41.881447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e844a8a7-d552-44e8-8f3b-5ee8b728322a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1509 microversion: 2.1 time: 0.272270 Sep 06 20:17:41.882126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 167/322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:41 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:41.983010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:41.985188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:41.992445 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:41.992933 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:41.993466 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:41.994143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:41.994653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:41.995073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:42.028927 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lazy-loading 'flavor' on Instance uuid c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:17:42.423616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5ae75a95-32b1-4f04-b97f-15f997a0e734 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/action" status: 202 len: 0 microversion: 2.20 time: 0.446069 Sep 06 20:17:42.429423 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 156/323] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 20:17:41 2022] POST /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 20:17:42.438016 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:42.439628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:42.451497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:42.452802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:42.454233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:42.455585 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:42.456496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:42.457290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:42.723634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:42.742814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:42.745012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:42.747833 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bdd3bb8f-32cf-4fbd-9f3f-52d0781c886c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.316380 Sep 06 20:17:42.748701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 168/324] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:42 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:17:42.920341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:42.925427 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:42.943980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:42.944651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:42.945229 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:42.946353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:42.947070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:42.947577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:43.153258 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:43.167289 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d909eea2-3155-4344-bc75-a37c37bf1fbf tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1509 microversion: 2.1 time: 0.263921 Sep 06 20:17:43.168419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 157/325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:42 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:43.807829 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:43.808976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:43.840202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:43.844909 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:43.877854 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:43.878797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:43.888096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:43.889918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:44.179470 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:44.196264 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:44.198436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:44.199242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:44.201152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:44.228874 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-60f4724e-1a6f-47af-8280-ea8ab49aab94 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.417336 Sep 06 20:17:44.229215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:44.229215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:44.229215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:44.229215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:44.229818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:44.229818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:44.231676 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 169/326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:43 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:17:44.436471 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:44.453359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3e03dabd-8dc1-4785-bb75-c28d38cd0288 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1515 microversion: 2.1 time: 0.260550 Sep 06 20:17:44.459231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 158/327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:44 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:45.269141 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:45.270304 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:45.285474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:45.286724 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:45.288071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:45.289707 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:45.290841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:45.292247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:45.589903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:45.612585 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:45.615729 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:45.618361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bc1c799d-c86a-402b-8f38-43fe893bd0a6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.357599 Sep 06 20:17:45.619845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 170/328] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:45 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:17:46.360088 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-690a29dd-cd25-4bfe-8162-b4cc73d52f2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'create', calling method: .version_select at 0x7f9c3bec1550>, body: {"keypair": {"name": "tempest-keypair-1158101110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdkqYIuU6lKp79XHZdA4Lgt5dqc+R7PA6TQ5nk191cvhfNDvWm6LoueekSPNgm/uX3skJ6GT+z2xxrg40cyN1DhfkbPmgtBhOBm7yQNbcByzDERs4EwG/GeaTLTV/DQ3Q=="}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:46.407666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-690a29dd-cd25-4bfe-8162-b4cc73d52f2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for project b005ff023a9f46fda3ceef605996c385. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:17:46.421416 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-690a29dd-cd25-4bfe-8162-b4cc73d52f2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for user ecde3e4bfd8b4f3490edd3832cea9e48 and project b005ff023a9f46fda3ceef605996c385. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:17:46.469962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "432aab3d-bb38-4064-8d58-e9084ae35e5e", "device": "/dev/sdb"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:46.477757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:46.488220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:46.488777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:46.489223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:46.490143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:46.490611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:46.491045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:46.550903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-690a29dd-cd25-4bfe-8162-b4cc73d52f2b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194690 Sep 06 20:17:46.552717 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 159/329] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:17:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:46.655707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:46.659756 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:46.694409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:46.695738 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:46.697817 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:46.699507 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:46.700611 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:46.701665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:47.089011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:47.102112 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:47.104672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:47.106345 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-076ae228-6921-40d8-8f85-ef715a29cf15 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.459850 Sep 06 20:17:47.126699 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 160/330] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:46 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:17:47.294150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3c8392b8-156f-4d98-ba83-42f0babbefc2 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "POST /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831290 Sep 06 20:17:47.300312 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 171/331] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:17:46 2022] POST /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:17:48.146208 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:48.147613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:48.150744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:48.162786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:48.163969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:48.164643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:48.166138 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:48.166890 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:48.167527 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:48.559139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:48.587849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:48.591027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:48.593078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a4371d7e-439a-4296-b039-d6fae85c30ba tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.451720 Sep 06 20:17:48.595528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 161/332] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:48 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:17:49.630979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:49.632541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:49.652746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:49.657215 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:49.660668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:49.664508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:49.668701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:49.669980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:49.723596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-460359883", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "568e35b6-fbc9-4b87-a50a-12e269b16c2c"}], "security_groups": [{"name": "tempest-securitygroup--1646598950"}], "key_name": "tempest-keypair-1158101110", "user_data": "}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:50.134534 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] validate_networks() for [('568e35b6-fbc9-4b87-a50a-12e269b16c2c', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:17:50.334902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:50.352727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:50.358399 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:50.359856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-76225832-f0fc-45c1-9683-8af49c22bd4a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.740882 Sep 06 20:17:50.377535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 172/333] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:49 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:17:51.082939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:17:51.083693 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:17:51.084088 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:17:51.084563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:17:51.084984 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:17:51.095812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:51.096347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:51.096825 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:51.097689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:51.098196 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:51.098675 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:51.108450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:51.126591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for project b005ff023a9f46fda3ceef605996c385. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:17:51.135454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Getting quotas for user ecde3e4bfd8b4f3490edd3832cea9e48 and project b005ff023a9f46fda3ceef605996c385. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:17:51.161043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:17:51.165332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:17:51.307538 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-773ac511-3eb1-4ae9-a644-0eb7d72279c7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.595163 Sep 06 20:17:51.310590 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 162/334] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:17:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:17:51.325472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0dff881c-24ff-4a94-b2fd-d1219b88035e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:51.327622 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0dff881c-24ff-4a94-b2fd-d1219b88035e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:51.434467 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:51.437952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:51.449497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0dff881c-24ff-4a94-b2fd-d1219b88035e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:51.465970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0dff881c-24ff-4a94-b2fd-d1219b88035e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1245 microversion: 2.1 time: 0.146814 Sep 06 20:17:51.472831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 173/335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:51 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:51.493712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:51.496233 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:51.498924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:51.508000 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:51.511169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:51.511994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:51.847955 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:51.895058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:51.901163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:51.910119 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b8b8d664-091d-49d7-b02b-3b6ce9049cd4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.481656 Sep 06 20:17:51.912111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 163/336] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:51 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:17:52.193938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-96474c21-5532-4814-a9e7-0fe080ecac1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: .version_select at 0x7f9c37baf5e0>, body: {"keypair": {"name": "tempest-keypair-167102266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxfimPsaZsv+BSBiipWCSaGkmu8COyKeWZi9y9W5s1z+9YbF7BoNnTokqpMsiBZf94EHmjhk3+wQHFK44c7OyuRZk1mi9wyzeoAAACxkAxE1WWgk4uJs3b5hiP8MdEGVA=="}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:52.252483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-96474c21-5532-4814-a9e7-0fe080ecac1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:17:52.268863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-96474c21-5532-4814-a9e7-0fe080ecac1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:17:52.354936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-96474c21-5532-4814-a9e7-0fe080ecac1a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161695 Sep 06 20:17:52.358071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 174/337] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:17:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:17:52.504654 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ad27ad37-6f90-4ecd-9403-27b5cea6c817 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:52.505958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ad27ad37-6f90-4ecd-9403-27b5cea6c817 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:52.708768 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ad27ad37-6f90-4ecd-9403-27b5cea6c817 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:52.741871 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ad27ad37-6f90-4ecd-9403-27b5cea6c817 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1245 microversion: 2.1 time: 0.246566 Sep 06 20:17:52.743285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 164/338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:52 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1245 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:52.957892 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:52.958813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:52.978605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:52.979136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:52.979623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:52.980511 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:52.980988 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:52.981421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:52.987301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:53.302233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:53.316197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:53.333039 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:53.340797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2983e03d-d051-4a13-bcf8-66e87e9d538c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.385879 Sep 06 20:17:53.344403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 175/339] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:52 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:17:53.773738 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:53.775450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:53.809040 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:53.814447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:53.815682 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:53.817475 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:53.822759 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:53.824272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:53.981092 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:54.018646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-586b931a-4888-411c-933b-c5aae3e4dea4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1297 microversion: 2.1 time: 0.253012 Sep 06 20:17:54.057005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 165/340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:53 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1297 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:54.380855 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:54.382454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:54.393220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:54.394736 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:54.395507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:54.397752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:54.401942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:54.402744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:55.075045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:55.092554 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:55.094252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:55.115014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:55.115973 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:55.119304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:55.120185 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:55.122990 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:55.124089 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:55.130459 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:55.131519 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ab8c7255-a4ff-4e37-ab0f-590df3a7004d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.758141 Sep 06 20:17:55.133002 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 176/341] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:54 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:17:55.135456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:55.389759 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:55.402913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-58f4227b-973c-4659-ad72-2917e2ed119e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1315 microversion: 2.1 time: 0.316672 Sep 06 20:17:55.408602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 166/342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:55 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:17:56.200223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:56.204093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:56.240197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:56.245514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:56.247226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:56.252668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:56.254080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:56.254877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:56.460935 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:56.462359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:56.477810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:56.480465 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:56.481186 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:56.482600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:56.483472 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:56.486474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:56.591350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:56.603010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-107e33eb-46c9-4ef5-a7ab-1118fc07f772 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1303 microversion: 2.1 time: 0.149810 Sep 06 20:17:56.605144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 167/343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:56 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:56.624837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-226716631", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1afac54-5c6c-4b09-a9a4-d3257ac1482d"}], "security_groups": [{"name": "tempest-securitygroup--2125886513"}], "key_name": "tempest-keypair-167102266", "user_data": "}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:17:56.755640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:56.774620 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:56.777740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:56.779480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8e878c51-e54a-4a82-9300-58045bfaea90 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.595772 Sep 06 20:17:56.799417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 177/344] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:56 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:17:56.877497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] validate_networks() for [('d1afac54-5c6c-4b09-a9a4-d3257ac1482d', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:17:57.634709 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:57.636878 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:57.671995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:57.673420 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:57.674622 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:57.676343 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:57.677569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:57.684630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:57.824953 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:17:57.829096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:17:57.831242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:17:57.833938 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:17:57.836560 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:17:57.866475 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:57.867945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:57.868946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:57.870549 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:57.871381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:57.872343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:57.940230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:17:57.956636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:17:57.983051 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:17:57.994723 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:17:58.117062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:58.123767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-51fe3f0a-a481-4580-b0e1-aab1a2a74308 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.517364 Sep 06 20:17:58.126343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 168/345] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:17:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:17:58.152467 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:58.158324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:58.190196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f8626250-de9b-41b6-b2e4-e59096f4de1e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.554118 Sep 06 20:17:58.196230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:58.200363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:58.201283 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:58.201536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 178/346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:57 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:58.206979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:58.208067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:58.208969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:58.260615 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1c3137fb-2e86-46b9-b601-70b3d7682ddc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:58.292616 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1c3137fb-2e86-46b9-b601-70b3d7682ddc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:58.832643 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1c3137fb-2e86-46b9-b601-70b3d7682ddc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:58.850148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1c3137fb-2e86-46b9-b601-70b3d7682ddc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1240 microversion: 2.1 time: 0.644598 Sep 06 20:17:58.850869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 179/347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:58 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1240 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:17:59.146681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:59.198373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:59.208887 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:17:59.219304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0f2a323c-e406-494f-bb23-820721e1a678 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 1.090424 Sep 06 20:17:59.221251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 169/348] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:17:58 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:17:59.245476 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:59.254603 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:59.317311 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:17:59.346980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:59.347941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:59.348762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:59.350180 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:59.365172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:59.370557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:59.885043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:17:59.886255 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:17:59.920880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:59.923305 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:59.923877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:17:59.928073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:17:59.929026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:17:59.929728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:00.114770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:00.142629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-96902db9-ef5c-48b8-bfba-4890b9ccd7a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.915961 Sep 06 20:18:00.144250 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 180/349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:59 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:00.157431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-27b0a5b9-1ac0-43d3-9db7-3a14aa48785c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:00.188453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-27b0a5b9-1ac0-43d3-9db7-3a14aa48785c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:00.189264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:00.190287 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-27b0a5b9-1ac0-43d3-9db7-3a14aa48785c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:00.191052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-27b0a5b9-1ac0-43d3-9db7-3a14aa48785c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:00.214946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8f9d5292-9cd9-459f-be02-dfb696a9c8ec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1244 microversion: 2.1 time: 0.337058 Sep 06 20:18:00.222461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 170/350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:17:59 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1244 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:00.256170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:00.261868 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:00.285738 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:00.287107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:00.288159 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:00.289747 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:00.300283 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:00.301478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:00.407646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-27b0a5b9-1ac0-43d3-9db7-3a14aa48785c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Going to try to stop instance {{(pid=120952) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 20:18:00.477568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-27b0a5b9-1ac0-43d3-9db7-3a14aa48785c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action" status: 202 len: 0 microversion: 2.1 time: 0.331474 Sep 06 20:18:00.479053 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 181/351] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:18:00 2022] POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:18:00.491091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:00.492343 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:00.501331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:00.503895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:00.505181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:00.506340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:00.507073 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:00.507734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:00.806210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:00.819802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a10f1324-da9a-45ba-b2cd-116e046e3b03 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.333398 Sep 06 20:18:00.823439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 182/352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:00 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:00.916636 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-56bd352a-08f9-43a5-9eb2-4599d481f938 req-32ae8ea1-e1fa-4b01-9b4a-e4b1d9054828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb7e4a2-f24c-4129-8d88-30e71c6d9f73", "tag": "5537e79d-e372-4591-84d5-3fd4a3bca85d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:00.933265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-56bd352a-08f9-43a5-9eb2-4599d481f938 req-32ae8ea1-e1fa-4b01-9b4a-e4b1d9054828 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:00.934506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-56bd352a-08f9-43a5-9eb2-4599d481f938 req-32ae8ea1-e1fa-4b01-9b4a-e4b1d9054828 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:00.935221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-56bd352a-08f9-43a5-9eb2-4599d481f938 req-32ae8ea1-e1fa-4b01-9b4a-e4b1d9054828 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:00.958041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-56bd352a-08f9-43a5-9eb2-4599d481f938 req-32ae8ea1-e1fa-4b01-9b4a-e4b1d9054828 service nova] Creating event network-changed:5537e79d-e372-4591-84d5-3fd4a3bca85d for instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 on hv-cinder-84773 Sep 06 20:18:00.968534 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-56bd352a-08f9-43a5-9eb2-4599d481f938 req-32ae8ea1-e1fa-4b01-9b4a-e4b1d9054828 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058137 Sep 06 20:18:00.971148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 183/353] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:18:01.051442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:01.080056 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:01.091783 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:01.096913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5dfe5d64-9655-4722-a8c7-ef6943dfa6e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.851144 Sep 06 20:18:01.105172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 171/354] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:00 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:01.183296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:01.191270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:01.209434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:01.210341 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:01.222235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:01.223698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:01.236634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:01.239585 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:01.262506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:01.263682 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:01.280014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:01.282206 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:01.283071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:01.285219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:01.287605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:01.288904 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:01.432650 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:01.459879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c6325f87-9807-444b-a4ea-4d958c4a88de tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1244 microversion: 2.1 time: 0.212757 Sep 06 20:18:01.469911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 172/355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:01 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1244 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:01.588693 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:01.602778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-83304ea8-c79c-4c24-a45d-9ca3f35c3fbe tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.426759 Sep 06 20:18:01.617697 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 184/356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:01 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:01.853714 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:01.854798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:01.875537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:01.876507 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:01.894166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:01.894166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:01.894166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:01.894166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:02.172497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:02.174215 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:02.220639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:02.222861 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:02.225795 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:02.233375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:02.237104 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:02.238682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:02.679541 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:02.712803 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1292c3a3-e447-4244-9cc8-9de61dc6f75b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.864630 Sep 06 20:18:02.717632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 173/357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:01 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:02.732594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:02.746350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:02.769384 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:02.770410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:02.771089 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:02.772123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:02.772851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:02.773517 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:02.924820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:02.941169 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:02.946688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:02.950733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-766c7f2a-29cd-4783-b3dc-e5b8b610deeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.819294 Sep 06 20:18:02.961661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 185/358] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:02 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:02.973670 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:02.973670 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:02.996383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:02.996383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:02.997175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:02.999156 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:02.999363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:03.006845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:03.010229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:03.037017 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e2356199-7b4c-4d32-b634-f2f2fe8cad50 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1236 microversion: 2.1 time: 0.313882 Sep 06 20:18:03.038109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 174/359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:02 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1236 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:03.478154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:03.525862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1271f405-f627-4ff1-9175-65526959e1e9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.569605 Sep 06 20:18:03.528507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 186/360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:02 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:03.760664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:03.763445 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:03.794603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:03.795527 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:03.796348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:03.798066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:03.798964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:03.799772 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:04.010490 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:04.013731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:04.039294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:04.040665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:04.041839 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:04.043946 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:04.045190 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:04.046980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:04.428562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:04.453854 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:04.464652 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:04.464991 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:04.466843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bca7a04f-3a0f-4eba-b689-e75f98b543fb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.465481 Sep 06 20:18:04.473690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 187/361] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:03 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:04.479798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:04.484280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:04.497181 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d0a2b9aa-0ad9-4122-9391-16fe4074de9c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.744800 Sep 06 20:18:04.505828 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 175/362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:03 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:04.509526 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:04.510580 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:04.511200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:04.512174 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:04.512969 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:04.513867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:04.574254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:04.574879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:04.589514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:04.590148 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:04.590592 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:04.591416 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:04.591907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:04.592343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:04.683559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:04.693632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ac4eef9f-f2a2-484e-8f4c-6749769127d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1236 microversion: 2.1 time: 0.222773 Sep 06 20:18:04.696321 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 188/363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:04 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1236 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:05.429417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:05.442913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e521eea7-8968-4794-ab85-e108a0079175 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.872661 Sep 06 20:18:05.444304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 176/364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:04 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:05.517561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:05.518343 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:05.527261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:05.528070 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:05.528799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:05.529761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:05.530535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:05.531090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:05.550471 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:05.551494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:05.582585 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:05.583458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:05.584078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:05.584998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:05.585768 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:05.586381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:06.055622 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:06.076523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:06.082733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:06.085088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e993f361-6cbb-40b7-b18f-1cb852b04e8e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.572086 Sep 06 20:18:06.087092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 189/365] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:05 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:06.095530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:06.096398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:06.108613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:06.119943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:06.122216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:06.123263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:06.128142 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:06.129023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:06.537389 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:06.548356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6fc52174-7f08-4b3c-ae1f-676bd5add009 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 1.002804 Sep 06 20:18:06.574119 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 177/366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:05 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:06.579476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:06.580374 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:06.607452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:06.609848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:06.618410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:06.619166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:06.620089 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:06.620712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:06.621333 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:06.649700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e94cf1d8-c28a-4cd6-aede-cf4bbad72855 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1292 microversion: 2.1 time: 0.550796 Sep 06 20:18:06.651214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 190/367] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:06 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1292 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:07.120507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:07.121827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:07.144037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:07.146063 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:07.150093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:07.152233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:07.154890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:07.157147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:07.450877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:07.484449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fa9acd49-a564-49d1-b9b0-24f84bd4a44a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.907325 Sep 06 20:18:07.485458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 178/368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:06 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:07.491533 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:07.521356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:07.553940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:07.555728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-049d7fca-3a2f-47a0-93d1-cde9ebc1e600 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1744 microversion: 2.20 time: 0.442397 Sep 06 20:18:07.562769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 191/369] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:07 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1744 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:07.583808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:07.584513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:07.603371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:07.604728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:07.607102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:07.610107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:07.613948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:07.617930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:07.704944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:07.706880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:07.737800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:07.738430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:07.742779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:07.744107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:07.751578 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:07.752744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:07.819917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:07.892888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=4 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:07.940679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:07.964595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-67352889-22ab-4a06-9cb2-ca1cb4edeebd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1292 microversion: 2.1 time: 0.266439 Sep 06 20:18:07.970848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=18 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:07.979845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 192/370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:07 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1292 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:08.397321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:08.436892 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d73c27bb-be8a-4d0d-970d-b77035b23ce8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.858377 Sep 06 20:18:08.447022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 179/371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:07 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:08.561407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:08.566085 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:08.579119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:08.579720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:08.580233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:08.581224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:08.581807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:08.582308 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:08.597882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:08.600162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:08.609387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:08.611342 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:08.612914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:08.613870 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:08.616695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:08.617282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:08.849588 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=8 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:09.030567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:09.041239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-db5663ba-f32d-42ca-96bc-229643a7e6a8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.498073 Sep 06 20:18:09.054484 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 193/372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:08 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:09.068445 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:09.070408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:09.106802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:09.112675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:09.114454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:09.116043 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:09.117210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:09.117492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:09.383563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:09.410452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d8663d5e-e82a-40c1-87d3-f81248df488b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1310 microversion: 2.1 time: 0.350036 Sep 06 20:18:09.414379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 194/373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:09 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1310 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:09.485808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:09.487003 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:09.507935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:09.508586 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:09.509051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:09.509854 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:09.517379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:09.518869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:09.526713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:09.556956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:09.563593 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:09.567212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d4dfe283-c888-495c-b950-3448cc3aa3ec tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1744 microversion: 2.20 time: 0.978815 Sep 06 20:18:09.571466 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 180/374] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:08 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1744 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:10.089364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:10.099134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:10.099709 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:10.118669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:10.120456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-90daa7c6-adc3-4a6c-90a2-cbdc7e522ffd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.639445 Sep 06 20:18:10.121167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:10.121836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:10.123209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:10.126267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:10.131658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:10.145428 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:10.159684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 195/375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:09 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:10.440990 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:10.442174 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:10.454414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:10.455451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:10.458208 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:10.459605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:10.464496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:10.466938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:10.631929 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:10.665626 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1fb08c0b-af28-4c4e-bcaf-2a75fdeca78e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.570599 Sep 06 20:18:10.668314 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 181/376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:10 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:10.678362 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:10.679840 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:10.688144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:10.700819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:10.702568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:10.704466 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:10.706204 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:10.707373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:10.708373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:10.729216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1ff4641c-6eba-42ad-a33c-ab007980fad9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1298 microversion: 2.1 time: 0.284858 Sep 06 20:18:10.730753 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 196/377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:10 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1298 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:10.793656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-202fbd64-bc75-4a5b-a807-0488f934524b req-599776a8-3a8b-4f53-a9c8-06f6e25b0d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f6b5ee-95cf-4e73-8124-578bcbcd7c19", "name": "network-vif-plugged", "status": "completed", "tag": "9eaa793d-1594-4913-b5c0-8b0669ff04be"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:10.859994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-202fbd64-bc75-4a5b-a807-0488f934524b req-599776a8-3a8b-4f53-a9c8-06f6e25b0d40 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:10.866913 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-202fbd64-bc75-4a5b-a807-0488f934524b req-599776a8-3a8b-4f53-a9c8-06f6e25b0d40 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:10.870314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-202fbd64-bc75-4a5b-a807-0488f934524b req-599776a8-3a8b-4f53-a9c8-06f6e25b0d40 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:10.933869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-202fbd64-bc75-4a5b-a807-0488f934524b req-599776a8-3a8b-4f53-a9c8-06f6e25b0d40 service nova] Creating event network-vif-plugged:9eaa793d-1594-4913-b5c0-8b0669ff04be for instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 on hv-cinder-84773 Sep 06 20:18:10.958425 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-202fbd64-bc75-4a5b-a807-0488f934524b req-599776a8-3a8b-4f53-a9c8-06f6e25b0d40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207514 Sep 06 20:18:10.959084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 197/378] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:11.166378 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:11.169146 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:11.184440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:11.186750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:11.188056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:11.189372 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:11.190380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:11.191220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:11.690374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:11.702249 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7c16a57b-bce3-4a9b-8857-004112d806d1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.544739 Sep 06 20:18:11.710393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:11.727825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 198/379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:11 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:11.737357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:11.744481 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:11.754169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f7433b9a-caf6-4fb4-9442-c2ea76e95cbb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1744 microversion: 2.20 time: 1.083978 Sep 06 20:18:11.758255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:11.762604 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 182/380] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:10 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1744 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:11.763675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:11.786101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:11.790246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:11.791354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:11.800088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:11.801057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:11.801319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:11.802033 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:11.802487 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:11.819199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:11.820096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:11.822012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:11.824787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:11.825592 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:11.826311 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:12.308948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:12.320836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-37133d56-766f-4784-9762-135cfcc97335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1298 microversion: 2.1 time: 0.553816 Sep 06 20:18:12.332456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:12.336400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 183/381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:11 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1298 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:12.416639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-80eefba0-fa9d-42b8-9748-6bad3758b89f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.680391 Sep 06 20:18:12.417779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 199/382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:11 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:12.787838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:12.788455 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:12.806387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:12.813089 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:12.817191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:12.817945 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:12.820932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:12.823540 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:12.832640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:12.832640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:12.853558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:12.859756 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:12.861356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:12.864242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:12.881534 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:12.882961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:13.713066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:13.773673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:13.785581 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:13.788381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-efcb8725-c01b-4359-8017-6759dcbb7596 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.984541 Sep 06 20:18:13.800193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 200/383] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:12 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:13.809332 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:13.824735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:13.848215 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:13.863728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:13.865862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:13.869414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:13.870400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:13.871191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:14.252691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:14.283659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-951832a6-c676-4e2e-82ee-4097d40ec39e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 1.504476 Sep 06 20:18:14.295762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 184/384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:12 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:14.327003 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:14.347650 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:14.375915 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:14.378827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:14.379506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:14.385733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:14.391045 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:14.394725 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:14.462195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:14.480516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-45e18824-34a6-4b75-946a-858d957fa64d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.678589 Sep 06 20:18:14.489164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 201/385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:13 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:14.818740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:14.819702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:14.831024 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:14.831530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:14.831981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:14.832710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:14.833186 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:14.833656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:15.361198 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:15.407359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e81a9feb-6ebe-4fd8-b9a8-1d02a23bea1a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 1.092230 Sep 06 20:18:15.427557 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 185/386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:14 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:15.443629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:15.445011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:15.481039 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:15.481583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:15.482035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:15.482798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:15.483274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:15.484478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:15.770609 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:15.810835 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:15.822223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:15.827614 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b5bb04c0-0c62-47a2-adc0-69fdaa7f8781 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 1.012683 Sep 06 20:18:15.833063 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 202/387] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:14 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:15.852864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:15.863232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:15.900914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:15.913026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:15.921300 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:15.924159 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:15.926488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:15.927499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:16.117663 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:16.155575 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-eaabd74f-4620-4e6f-a401-6cf37cc47369 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.725778 Sep 06 20:18:16.174173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 186/388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:15 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:16.491754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:16.498170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:16.550613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:16.551570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:16.552371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:16.557660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:16.559067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:16.563316 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:16.933915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:16.978410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9655950b-4654-4ab2-ba1a-74fb27570ea1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 1.140807 Sep 06 20:18:16.986675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 203/389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:15 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:17.027325 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:17.028703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:17.080703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:17.083103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:17.085493 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:17.087537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:17.088877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:17.095438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:17.625992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:17.656442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:17.658255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:17.659631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c28fa385-28ee-433b-8411-0fc724d97866 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.671008 Sep 06 20:18:17.660363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 204/390] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:16 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:17.685999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:17.687101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:17.694410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:17.695392 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:17.696061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:17.697026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:17.697767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:17.698440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:18.195282 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:18.216228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d344e96e-1bf7-4f18-a00d-1078f625b664 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.536783 Sep 06 20:18:18.225658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 205/391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:17 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:18.251647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:18.255600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:18.286842 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:18.287818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:18.289224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:18.290343 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:18.293493 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:18.294317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:18.566651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:18.591959 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9db80b14-8897-4435-985d-591433bf873b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 2.108050 Sep 06 20:18:18.606436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 187/392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:16 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:18.692391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:18.696194 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:18.728626 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:18.730826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:18.734478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:18.738850 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:18.740245 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:18.740953 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:18.742306 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:18.888761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:18.903739 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8afa411a-2a3a-4436-97f9-191d88dc5612 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.670745 Sep 06 20:18:18.925984 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 206/393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:18 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:18.934205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-95e84665-c643-4313-8060-c8da4fc963c6 req-3202cc23-afd4-4cbc-816a-1da79ba47c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475e333a-a670-43c9-b18b-251a960ede71", "tag": "7e6adc77-9fc4-4658-9d15-0c9d656d3797"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:18.951005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-95e84665-c643-4313-8060-c8da4fc963c6 req-3202cc23-afd4-4cbc-816a-1da79ba47c93 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:18.951780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-95e84665-c643-4313-8060-c8da4fc963c6 req-3202cc23-afd4-4cbc-816a-1da79ba47c93 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:18.952386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-95e84665-c643-4313-8060-c8da4fc963c6 req-3202cc23-afd4-4cbc-816a-1da79ba47c93 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:18.967081 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-95e84665-c643-4313-8060-c8da4fc963c6 req-3202cc23-afd4-4cbc-816a-1da79ba47c93 service nova] Creating event network-changed:7e6adc77-9fc4-4658-9d15-0c9d656d3797 for instance 475e333a-a670-43c9-b18b-251a960ede71 on hv-cinder-84773 Sep 06 20:18:18.974560 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-95e84665-c643-4313-8060-c8da4fc963c6 req-3202cc23-afd4-4cbc-816a-1da79ba47c93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046043 Sep 06 20:18:18.975561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 207/394] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:19.347172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:19.349213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:19.391106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:19.395413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:19.416604 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:19.428883 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:19.435236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:19.438757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:19.979072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:20.004164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c5ddc781-19b0-48c7-a2e2-f1e45798c553 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.728992 Sep 06 20:18:20.008335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 208/395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:19 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:20.021369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:20.022976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:20.055225 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:20.064123 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:20.066870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:20.070073 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:20.072541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:20.076715 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:20.080152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:20.107795 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:20.121032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:20.138049 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4b881537-ef35-4b57-8fe4-ec43f940b061 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 1.450875 Sep 06 20:18:20.139749 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 188/396] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:18 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:20.166523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:20.173448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:20.211893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:20.221384 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:20.222965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:20.226337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:20.228864 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:20.233598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:20.831152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:20.840280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1f9dea10-c717-47cc-afcc-64f8dd85b3b0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.829087 Sep 06 20:18:20.861733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 209/397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:20 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:20.870189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-3d7a80f5-2c01-4a44-b8db-03c0f38e6c2c req-0bdde325-3456-44e5-9f08-afe571ff9517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb7e4a2-f24c-4129-8d88-30e71c6d9f73", "name": "network-vif-plugged", "status": "completed", "tag": "5537e79d-e372-4591-84d5-3fd4a3bca85d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:20.917205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3d7a80f5-2c01-4a44-b8db-03c0f38e6c2c req-0bdde325-3456-44e5-9f08-afe571ff9517 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:20.919940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3d7a80f5-2c01-4a44-b8db-03c0f38e6c2c req-0bdde325-3456-44e5-9f08-afe571ff9517 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:20.923431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3d7a80f5-2c01-4a44-b8db-03c0f38e6c2c req-0bdde325-3456-44e5-9f08-afe571ff9517 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:21.010573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-3d7a80f5-2c01-4a44-b8db-03c0f38e6c2c req-0bdde325-3456-44e5-9f08-afe571ff9517 service nova] Creating event network-vif-plugged:5537e79d-e372-4591-84d5-3fd4a3bca85d for instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 on hv-cinder-84773 Sep 06 20:18:21.036497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-3d7a80f5-2c01-4a44-b8db-03c0f38e6c2c req-0bdde325-3456-44e5-9f08-afe571ff9517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182886 Sep 06 20:18:21.041233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 210/398] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:21.055979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:21.060266 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:21.072688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:21.083198 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-00dd521a-e73a-48ae-818a-8a1d049003b3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.937712 Sep 06 20:18:21.083198 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 189/399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:20 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:21.117328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:21.125498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:21.131264 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:21.137304 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:21.145939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:21.146972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:21.178663 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:21.179992 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:21.204345 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:21.208077 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:21.210844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:21.212768 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:21.222663 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:21.230884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:21.265101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:21.762347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:21.775220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:21.779008 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:21.781952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-db252d78-9df2-4a61-b164-18a66b038c82 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.608097 Sep 06 20:18:21.782877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 190/400] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:21 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:21.893015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:21.894010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:21.902392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:21.903801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:21.907066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:21.909193 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:21.910577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:21.911794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:22.219616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:22.236830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-822fa7b8-ae7f-4027-9942-f8214cf0222a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.348089 Sep 06 20:18:22.241372 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 191/401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:21 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:22.256472 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:22.257415 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:22.272271 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:22.278487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:22.278970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:22.279751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:22.280220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:22.280649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:22.325101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:22.352206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b9a5c29a-ab34-4b9e-8278-784e2f1482c8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 1.297296 Sep 06 20:18:22.363532 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 211/402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:21 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:22.481819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:22.495365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ab11aaae-49bb-47fc-a3ed-559e6f45c757 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.249436 Sep 06 20:18:22.497444 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 192/403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:22 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:22.815301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:22.825310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:22.848494 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:22.850635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:22.854344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:22.861024 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:22.862496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:22.863661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:23.281213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:23.290655 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:23.313789 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:23.315362 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:23.316972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:23.318962 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:23.320257 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:23.321601 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:23.429428 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:23.466100 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:23.469061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:23.479819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0e7aff46-0180-4f78-8118-5982c31bdaeb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.673583 Sep 06 20:18:23.489899 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 212/404] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:22 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:23.501474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:23.514681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:23.547232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:23.552567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:23.553485 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:23.555289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:23.556198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:23.556944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:23.770576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:23.792952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9c8ca075-a581-49c4-800b-1e9cb0c04250 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.518963 Sep 06 20:18:23.795296 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 193/405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:23 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:23.805436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:23.807030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:23.821708 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:23.823244 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:23.824290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:23.826332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:23.827492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:23.828435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:23.980477 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:24.009735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-460b1be8-fda2-417d-a6ff-d076a4003d6e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.517424 Sep 06 20:18:24.023010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 213/406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:23 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:24.133826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:24.154546 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9a66af76-4957-46e2-9e0e-ecc08b704a2a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.348284 Sep 06 20:18:24.155350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 194/407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:23 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:24.544263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:24.550960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:24.589648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:24.591296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:24.597413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:24.599303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:24.604832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:24.606459 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:24.839608 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:24.840741 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:24.921515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:24.922688 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:24.934552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:24.936039 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:24.936870 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:24.944754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:25.487515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:25.500990 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-06ab3f36-12d5-4c00-afd3-02f552af5cc4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.667763 Sep 06 20:18:25.514388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 195/408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:24 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:25.528571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:25.529708 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:25.538225 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:25.539197 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:25.539888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:25.541011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:25.542057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:25.542774 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:25.799841 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:25.820295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2b5cc255-0f8d-4df7-b466-c5991142ad85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.301471 Sep 06 20:18:25.835393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 196/409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:25 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:25.871615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:25.872418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:25.900026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:25.900847 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:25.904547 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:25.908320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:25.910682 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:25.912263 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:25.965020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:25.988068 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:26.013897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:26.021754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-93aa9817-c4a0-4dd7-bee4-d02aacb993d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 1.484539 Sep 06 20:18:26.030674 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 214/410] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:24 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:26.333520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:26.344464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:26.358417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c397a8ac-bf2c-4edb-ad35-8f002a7ff02b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.501213 Sep 06 20:18:26.378636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 197/411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:25 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:26.541475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:26.553139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:26.577283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:26.579357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:26.580764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:26.582817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:26.584013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:26.585040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:26.864771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:26.865571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:26.877794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:26.878800 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:26.878946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:26.879727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:26.880517 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:26.881498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:26.988646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:27.008400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-91f4de0b-b5d9-4a2c-9de7-88f5baf8bdd5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.480009 Sep 06 20:18:27.009568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 215/412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:26 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:27.054699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:27.055677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:27.067781 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:27.068287 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:27.068731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:27.069701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:27.069975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:27.070410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:27.319550 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:27.348269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2e7dc1c1-a9a3-4536-9616-4651409df2c5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.487370 Sep 06 20:18:27.349502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 198/413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:26 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:27.382395 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:27.397095 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:27.398216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:27.412558 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:27.413502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:27.413906 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:27.416884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:27.417886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:27.418828 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:27.419874 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:27.420502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:27.422667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-12f13981-30d2-4b40-a622-e6dc4fa2d611 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.371838 Sep 06 20:18:27.438651 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 216/414] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:27 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:27.784928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:27.818806 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f3b79ecf-b975-4259-93ef-de0e70aa5ad7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.425733 Sep 06 20:18:27.853923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 199/415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:27 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:28.044655 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:28.047206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:28.061488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.063019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.064194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:28.066288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.067483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.068646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:28.381457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:28.382668 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:28.397837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.399129 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.401462 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:28.404361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.412626 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.414111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:28.430401 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:28.474940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-90930156-74b6-408c-8fae-141c47df3a1f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.437381 Sep 06 20:18:28.480504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 217/416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:28 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:28.518191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:28.521000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:28.548994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.565237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.566553 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:28.573691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.575516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.576691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:28.761501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:28.806167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e7c78d18-b898-4b1b-8908-fa4db8dbe4c7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.433458 Sep 06 20:18:28.809461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 200/417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:28 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:28.866062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:28.866879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:28.878195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.880584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.886001 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:28.887120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:28.887750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:28.888530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:29.216837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:29.254178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7058409b-bc7d-43dc-a35c-699cbc068a06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.392370 Sep 06 20:18:29.255777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 201/418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:28 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:29.534184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:29.541584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:29.578169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:29.582237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:29.583334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:29.587278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:29.593488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:29.594210 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:29.715665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:29.740837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:29.760638 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:29.778944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c0a821c8-4c4a-446b-9c8f-eb8682ec13ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 1.277596 Sep 06 20:18:29.780948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 218/419] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:28 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:29.886303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:29.887263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:29.910204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=78 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:29.912799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:29.914819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:29.915434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:29.916280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:29.916844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:29.917322 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:30.266764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:30.282510 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9a8878b7-38e6-446a-9f85-f3462cfe3356 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.759122 Sep 06 20:18:30.296011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 202/420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:29 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:30.306457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:30.307205 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:30.316043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:30.316568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:30.317025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:30.317892 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:30.318362 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:30.318790 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:30.528173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:30.533118 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:30.545699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-19f5e115-623e-40fa-9982-8ccc96ce9b7a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1724 microversion: 2.1 time: 0.699240 Sep 06 20:18:30.551936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5b911f3f-4e3e-4694-9ef4-da98e17fafc6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.253927 Sep 06 20:18:30.554394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 203/421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:30 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:30.564004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 219/422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:29 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1724 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:30.811734 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:30.813512 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:30.825201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:30.828989 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:30.832899 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:30.835003 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:30.835702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:30.836381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:31.169894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:31.190120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:31.193683 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:31.195970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-024ce165-33e1-4c04-a95e-8cf3db90f031 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.390615 Sep 06 20:18:31.197604 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 204/423] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:30 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:31.315570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:31.317115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:31.329867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:31.332315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:31.336235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:31.337331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:31.338193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:31.338860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:31.585556 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:31.586703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:31.636230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:31.637105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:31.648617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:31.650971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:31.651855 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:31.652684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:31.959166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:31.977364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c249d977-c3c0-43b3-b2b2-8e530c3941de tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.672337 Sep 06 20:18:31.978013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 220/424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:31 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:32.010046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:32.012902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:32.059156 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:32.060193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:32.062350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:32.087970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:32.089991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:32.098349 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:32.214023 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:32.232518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f01865d6-1eac-4d0b-b19e-364613420ebd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1701 microversion: 2.1 time: 0.658438 Sep 06 20:18:32.237084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 205/425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:31 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1701 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:32.256030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:32.259340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:32.287286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:32.288563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:32.291303 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:32.298690 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:32.299968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:32.300688 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:32.700012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:32.718544 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:32.723120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:32.727850 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5d921988-a101-4983-9f47-379f5497a109 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.483100 Sep 06 20:18:32.730726 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 206/426] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:32 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:32.739998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d4cd1679-c532-40d9-9255-2874f67093b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:32.747973 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4cd1679-c532-40d9-9255-2874f67093b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:32.748932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4cd1679-c532-40d9-9255-2874f67093b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:32.749835 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d4cd1679-c532-40d9-9255-2874f67093b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:32.918998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d4cd1679-c532-40d9-9255-2874f67093b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Going to try to start instance {{(pid=120951) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 20:18:32.941725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:32.988332 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8dcff322-b460-4c03-8e79-3330b249d5f5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.995182 Sep 06 20:18:32.992869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 221/427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:31 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:33.000960 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d4cd1679-c532-40d9-9255-2874f67093b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action" status: 202 len: 0 microversion: 2.1 time: 0.266216 Sep 06 20:18:33.002075 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 207/428] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:18:32 2022] POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:18:33.021336 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:33.039224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:33.039582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:33.041915 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:33.076645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:33.080005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:33.081259 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:33.081447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:33.082836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:33.086528 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:33.088289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:33.089450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:33.092685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:33.109944 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:33.111124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:33.112342 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:33.670511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:33.687461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-535987a2-fac7-44a0-a7f9-c32e54e09242 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1371 microversion: 2.1 time: 0.657651 Sep 06 20:18:33.692366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 208/429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:33 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1371 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:33.764979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:33.766374 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:33.784301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:33.784809 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:33.787009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:33.788015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:33.790329 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:33.793460 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:34.180602 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:34.199095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fab9c41a-5c64-4e7b-9b4c-98b978ebd761 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1710 microversion: 2.1 time: 1.186596 Sep 06 20:18:34.207993 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 222/430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:33 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1710 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:34.241340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:34.244847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:34.276361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:34.280427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:34.284905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:34.290194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:34.295262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:34.296943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:34.704199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:34.713069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-642774c7-fdf2-4577-8bc9-d9421e23edb6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.503462 Sep 06 20:18:34.726322 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 223/431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:34 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:34.801431 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:34.821414 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:34.826556 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:34.830487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-18528d96-5173-4960-bb0b-09391ed57ea6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 1.070490 Sep 06 20:18:34.833079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 209/432] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:33 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:34.850363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:34.851925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:34.891587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:34.897847 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:34.898941 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:34.899846 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:34.901569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:34.902648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:35.327708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6e47c491-a98c-4136-9779-dcd68e1ed0d9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Action: 'create', calling method: .version_select at 0x7f9c37adddc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-384168834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMCFAJRvZkb1C1AlX/E3B/nn0njdOI/ZIoRwUJoaigWYvSmNI/IeeN0VFtVKSrhDRsBMFvDdh0V5EOpD0wu15eCqzkPjVZoLSrU5okXelMGWdvgfOuZ9+Kaisg72QAQKg=="}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:35.402280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-6e47c491-a98c-4136-9779-dcd68e1ed0d9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Getting quotas for project b030ea0d617b4583a2397921c884aaa5. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:18:35.416856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-6e47c491-a98c-4136-9779-dcd68e1ed0d9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Getting quotas for user aaa686e692444eae835ca343926e0595 and project b030ea0d617b4583a2397921c884aaa5. Resources: {'key_pairs'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:18:35.485237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6e47c491-a98c-4136-9779-dcd68e1ed0d9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.755967 Sep 06 20:18:35.487973 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 224/433] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:18:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:35.501348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:35.503089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:35.519593 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:35.520879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:35.522134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:35.524521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:35.526113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:35.528497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.016600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:36.031960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d7cc6f57-d938-4fc7-98e3-d06427ec0de6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1710 microversion: 2.1 time: 0.540707 Sep 06 20:18:36.033361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 225/434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:35 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1710 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:36.040355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:36.042646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:36.051205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:36.052142 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:36.053796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.055440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:36.056305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:36.057019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.377344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:36.392061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-05d222b8-8011-4820-8c08-23851475cf15 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.356925 Sep 06 20:18:36.396718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 226/435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:36 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:36.403478 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:36.413283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:36.434172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:36.438852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:36.441121 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.445426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:36.446660 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:36.454465 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.573222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:36.627877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9aeb74b0-d1e2-4f71-bf6f-580d569075d0 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1565 microversion: 2.1 time: 1.790525 Sep 06 20:18:36.635150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 210/436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:34 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1565 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:36.681076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:36.690246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:36.725323 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:36.726134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:36.734815 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.736630 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:36.737932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:36.738611 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.892049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:36.913333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:36.917567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:36.920810 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-073eeb16-bbf5-4064-a012-8eec06885c33 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.521591 Sep 06 20:18:36.933653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 227/437] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:36 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:36.934678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-a1b595ee-bcea-4d57-933f-74c09d1de8b7 req-08c72437-59a4-4149-ad0f-1fb2b47a6a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475e333a-a670-43c9-b18b-251a960ede71", "name": "network-vif-plugged", "status": "completed", "tag": "7e6adc77-9fc4-4658-9d15-0c9d656d3797"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:36.958233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-a1b595ee-bcea-4d57-933f-74c09d1de8b7 req-08c72437-59a4-4149-ad0f-1fb2b47a6a2c service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:36.959331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-a1b595ee-bcea-4d57-933f-74c09d1de8b7 req-08c72437-59a4-4149-ad0f-1fb2b47a6a2c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:36.960116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-a1b595ee-bcea-4d57-933f-74c09d1de8b7 req-08c72437-59a4-4149-ad0f-1fb2b47a6a2c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:36.991307 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-a1b595ee-bcea-4d57-933f-74c09d1de8b7 req-08c72437-59a4-4149-ad0f-1fb2b47a6a2c service nova] Creating event network-vif-plugged:7e6adc77-9fc4-4658-9d15-0c9d656d3797 for instance 475e333a-a670-43c9-b18b-251a960ede71 on hv-cinder-84773 Sep 06 20:18:37.003604 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-a1b595ee-bcea-4d57-933f-74c09d1de8b7 req-08c72437-59a4-4149-ad0f-1fb2b47a6a2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077310 Sep 06 20:18:37.004870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 228/438] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:37.018437 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:37.019905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:37.035049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.035906 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.036867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:37.038561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.039393 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.040450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:37.089566 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lazy-loading 'services' on Instance uuid a830e29c-1ec8-4c0d-b5e6-1221c54c8953 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:18:37.114782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:37.316106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1fced46f-c35e-427c-a7f0-36e934cbf36c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.307094 Sep 06 20:18:37.317409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 229/439] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:18:37 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-interface => generated 285 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:37.354492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:37.362239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:37.388628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.392841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.394561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:37.402594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.404359 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.406352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:37.487354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-00ed4eab-df6e-4df1-9962-95c7722aba1d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953/os-volume_attachments/432aab3d-bb38-4064-8d58-e9084ae35e5e" status: 202 len: 0 microversion: 2.1 time: 0.845003 Sep 06 20:18:37.489007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 211/440] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:18:36 2022] DELETE /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953/os-volume_attachments/432aab3d-bb38-4064-8d58-e9084ae35e5e => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:18:37.549693 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:37.557556 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:37.594841 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.595442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.595872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:37.603082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.603625 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.604180 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:37.777760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:37.793533 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f26bbfad-2b33-476f-af94-12b80734eb42 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1710 microversion: 2.1 time: 0.461164 Sep 06 20:18:37.795547 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 230/441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:37 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1710 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:37.955224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:37.956142 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:37.979654 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.980496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.981114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:37.985274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:37.985714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:37.986165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:38.241866 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:38.273952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:38.298190 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:38.302326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9e3856c0-4f5f-4ca3-87e1-5eeba432ceb1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.352215 Sep 06 20:18:38.329216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 231/442] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:37 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:38.670882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:38.675918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:38.688533 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4b5c91d8-41a1-42c1-b689-d7ea2a987f58 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 1.188536 Sep 06 20:18:38.689954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 212/443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:37 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:38.825116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:38.826258 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:38.855551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:38.856324 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:38.857138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:38.858994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:38.859741 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:38.860502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:39.349347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:39.359279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:39.411094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:39.412009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:39.414567 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:39.416124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:39.419135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:39.422738 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:39.728856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:39.762075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-73ee51e0-2cdc-4333-80b7-120905d1a05e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1714 microversion: 2.1 time: 0.943822 Sep 06 20:18:39.763954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 232/444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:38 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1714 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:39.772741 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:39.774305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:39.828718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:39.831136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:39.834499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:39.836982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:39.838472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:39.839818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:40.364436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:40.402863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-70296e8e-88a7-4c31-b485-1fbbe98ac8bf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 0.636656 Sep 06 20:18:40.408408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 233/445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:39 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:40.430838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:40.436420 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:40.494959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:40.496512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:40.504605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:40.509070 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:40.516496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:40.520512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:40.605364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:18:40.874043 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7ace52dc-6ffc-4cc8-a944-03766044c874 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 204 len: 0 microversion: 2.1 time: 0.462401 Sep 06 20:18:40.877204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 234/446] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:18:40 2022] DELETE /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:18:40.906821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:40.908707 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:40.939911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:40.942745 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:40.946948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:40.950598 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:40.959078 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:40.959537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:41.361796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:41.379670 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:41.391870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-943c65ca-1e68-46aa-b1a0-207d7297ec4a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1514 microversion: 2.1 time: 0.505835 Sep 06 20:18:41.399411 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 235/447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:40 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1514 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:41.450490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:41.455654 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:41.455898 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:41.456845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:41.458091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a597ce62-a090-4bd3-a7e1-cc1c09f708f0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 2.124322 Sep 06 20:18:41.508149 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:41.510055 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:41.512779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:41.513896 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 213/448] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:39 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:41.518222 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:41.519330 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:41.520296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:42.460674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:42.461642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:42.491256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:42.492132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:42.492866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:42.503218 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:42.503546 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:42.509127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:42.566979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:42.652998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-492a464e-6d6e-48cb-8ddf-432b7174bcde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1366 microversion: 2.1 time: 1.198567 Sep 06 20:18:42.660025 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 236/449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:41 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1366 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:42.695777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:42.698791 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:42.734749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:42.738565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:42.743024 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:42.752053 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:42.754972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:42.760210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:43.223600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:43.236661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-12b17059-6cb1-41ee-b16a-ef0599e7b307 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1514 microversion: 2.1 time: 0.781194 Sep 06 20:18:43.244265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 214/450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:42 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1514 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:18:43.273792 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-8a3d85ee-d688-49d8-869c-c5e2acbd677a req-9f13eb80-edb4-4bca-aabf-1856d0e5c2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb7e4a2-f24c-4129-8d88-30e71c6d9f73", "tag": "5537e79d-e372-4591-84d5-3fd4a3bca85d"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:43.326908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-8a3d85ee-d688-49d8-869c-c5e2acbd677a req-9f13eb80-edb4-4bca-aabf-1856d0e5c2d1 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:43.328318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-8a3d85ee-d688-49d8-869c-c5e2acbd677a req-9f13eb80-edb4-4bca-aabf-1856d0e5c2d1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:43.331032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-8a3d85ee-d688-49d8-869c-c5e2acbd677a req-9f13eb80-edb4-4bca-aabf-1856d0e5c2d1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:43.396098 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-8a3d85ee-d688-49d8-869c-c5e2acbd677a req-9f13eb80-edb4-4bca-aabf-1856d0e5c2d1 service nova] Creating event network-changed:5537e79d-e372-4591-84d5-3fd4a3bca85d for instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 on hv-cinder-84773 Sep 06 20:18:43.409143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:43.416455 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-8a3d85ee-d688-49d8-869c-c5e2acbd677a req-9f13eb80-edb4-4bca-aabf-1856d0e5c2d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152201 Sep 06 20:18:43.420912 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 215/451] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:43.421201 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:43.423195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:43.425037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b3d30dee-f22a-4730-b52a-7847a8bfa451 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 0.758273 Sep 06 20:18:43.426007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 237/452] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:42 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:43.715197 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:43.721874 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:43.768390 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:43.776399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:43.777812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:43.782041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:43.788947 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:43.791839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:44.277015 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:44.277902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:44.301601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:44.304672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:44.305298 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:44.307645 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:44.308303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:44.310917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:44.435164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:44.471143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b60432a5-febe-4233-bf86-f133d75eea31 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1556 microversion: 2.1 time: 0.762715 Sep 06 20:18:44.474631 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 216/453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:43 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1556 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:44.501852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:44.503073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:44.538131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:44.540289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:44.546998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:44.548299 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:44.554511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:44.555732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:44.559558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b63d3722-d6c1-4728-86ae-80edde628f14 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1472 microversion: 2.1 time: 0.289196 Sep 06 20:18:44.560236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:44.578091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 238/454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:44 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:44.580379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:44.581147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:44.598584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:44.600438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:44.601894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:44.604418 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:44.605203 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:44.606306 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:45.001320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c486d237-de3a-49cd-9c76-ee90fe97ccf4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.433943 Sep 06 20:18:45.002641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 239/455] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:18:44 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71/os-interface => generated 285 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:45.022501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-b69b9caa-d7b7-45ac-8e8f-cb94fb75f214 req-8e468af3-6822-464a-91b2-ef31c90d4d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a830e29c-1ec8-4c0d-b5e6-1221c54c8953", "name": "network-vif-deleted", "tag": "28379454-0bd6-4566-88f1-908dde2c0b81"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:45.058195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-b69b9caa-d7b7-45ac-8e8f-cb94fb75f214 req-8e468af3-6822-464a-91b2-ef31c90d4d0f service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:45.061031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-b69b9caa-d7b7-45ac-8e8f-cb94fb75f214 req-8e468af3-6822-464a-91b2-ef31c90d4d0f service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:45.063023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-b69b9caa-d7b7-45ac-8e8f-cb94fb75f214 req-8e468af3-6822-464a-91b2-ef31c90d4d0f service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:45.109903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-b69b9caa-d7b7-45ac-8e8f-cb94fb75f214 req-8e468af3-6822-464a-91b2-ef31c90d4d0f service nova] Creating event network-vif-deleted:28379454-0bd6-4566-88f1-908dde2c0b81 for instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 on hv-cinder-84773 Sep 06 20:18:45.127734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-b69b9caa-d7b7-45ac-8e8f-cb94fb75f214 req-8e468af3-6822-464a-91b2-ef31c90d4d0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110914 Sep 06 20:18:45.129097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 240/456] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:45.515748 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:45.544055 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:45.552410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:45.555246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e81b73a6-d9fd-427d-82f2-eac800f5baa7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1739 microversion: 2.20 time: 1.078687 Sep 06 20:18:45.572381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 217/457] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:44 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1739 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:45.622989 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:45.624419 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:45.640808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=4 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:45.653584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:45.655180 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:45.656812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:45.658435 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:45.680867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:45.682367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:45.848624 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:45.850089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:45.851677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:45.852673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lazy-loading 'fault' on Instance uuid a830e29c-1ec8-4c0d-b5e6-1221c54c8953 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:18:46.131644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:46.147916 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e810fd9f-3645-47f7-b094-967cd478f1bd tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 200 len: 1308 microversion: 2.1 time: 0.533542 Sep 06 20:18:46.153009 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 241/458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:45 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:18:46.612040 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:46.620375 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:46.665687 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:46.666800 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:46.667641 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:46.669291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:46.670248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:46.671165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:47.097457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:47.120606 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:47.123813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:47.127231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1c6781af-3ffe-44c8-b5c8-05ec705a3e66 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1721 microversion: 2.20 time: 0.524956 Sep 06 20:18:47.142606 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 218/459] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:46 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1721 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:47.204065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:47.206704 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: a830e29c-1ec8-4c0d-b5e6-1221c54c8953] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:47.228032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:47.232163 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:47.232856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:47.236308 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:47.236974 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:47.239733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:47.276219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] HTTP exception thrown: Instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 could not be found. Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Request method failure captured: Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 HTTP/1.1 Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6q3jtWZl3OtKA5VodomCyo1q98cHTZLDr-9Ip_IIiWfvdKIsvq_I6LQonD-lRc4kv06h-r1JkPoFz138p7qKWH1IMUZPVvreuhjJfidBHH4pIUVdKwqJDRh4N8UL4Dk-8PQthAmQz_RTVD3pPQWTWIe8-7T0Q50OP9iTtvM7w8A_Vg Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: b5de971d8037434fbaf3c5aa93729028 Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesSnapshotTestJSON-514333503 Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:18:47.289998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesSnapshotTestJSON-514333503 Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: b5de971d8037434fbaf3c5aa93729028 Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-514333503 Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesSnapshotTestJSON-514333503-project Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 87f8cc79586f4cb79c962ede8342f580 Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesSnapshotTestJSON-514333503-project Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 could not be found. Sep 06 20:18:47.292623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'a830e29c-1ec8-4c0d-b5e6-1221c54c8953'} Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 could not be found. Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:18:47.294877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 could not be found. Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 could not be found. Sep 06 20:18:47.298656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:18:47.306814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Returning 404 to user: Instance a830e29c-1ec8-4c0d-b5e6-1221c54c8953 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:18:47.308714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3f4c4eb0-8977-4ff5-9159-6740256edf05 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953" status: 404 len: 111 microversion: 2.1 time: 0.117575 Sep 06 20:18:47.321758 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 242/460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:18:47 2022] GET /compute/v2.1/servers/a830e29c-1ec8-4c0d-b5e6-1221c54c8953 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:18:48.072360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-459cf47f-c1a3-4235-b4ce-db243116dd34 req-e1636961-c912-49c5-8258-69a47bd97090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f6b5ee-95cf-4e73-8124-578bcbcd7c19", "name": "network-vif-unplugged", "status": "completed", "tag": "9eaa793d-1594-4913-b5c0-8b0669ff04be"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:48.113940 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-459cf47f-c1a3-4235-b4ce-db243116dd34 req-e1636961-c912-49c5-8258-69a47bd97090 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:48.114501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-459cf47f-c1a3-4235-b4ce-db243116dd34 req-e1636961-c912-49c5-8258-69a47bd97090 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:48.114964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-459cf47f-c1a3-4235-b4ce-db243116dd34 req-e1636961-c912-49c5-8258-69a47bd97090 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:48.154395 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-459cf47f-c1a3-4235-b4ce-db243116dd34 req-e1636961-c912-49c5-8258-69a47bd97090 service nova] Creating event network-vif-unplugged:9eaa793d-1594-4913-b5c0-8b0669ff04be for instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 on hv-cinder-84773 Sep 06 20:18:48.175955 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:48.176852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:48.198831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:48.198831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:48.198831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:48.198831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:48.205266 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-459cf47f-c1a3-4235-b4ce-db243116dd34 req-e1636961-c912-49c5-8258-69a47bd97090 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174152 Sep 06 20:18:48.206359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 219/461] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:48.214545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:48.215881 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:48.621595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:48.643446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:48.645936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:48.649222 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d71ea443-b9d2-40fc-9e74-677abea0c320 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1721 microversion: 2.20 time: 0.478636 Sep 06 20:18:48.650959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 243/462] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:48 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1721 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:48.941706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-5d55cbe1-d127-4452-9b29-f0264fcb3f17 req-7ff1d5a8-2f7a-42c0-a6a0-567f12aa0eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "475e333a-a670-43c9-b18b-251a960ede71", "tag": "7e6adc77-9fc4-4658-9d15-0c9d656d3797"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:48.951081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=64 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:48.968432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-5d55cbe1-d127-4452-9b29-f0264fcb3f17 req-7ff1d5a8-2f7a-42c0-a6a0-567f12aa0eb8 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:48.969343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-5d55cbe1-d127-4452-9b29-f0264fcb3f17 req-7ff1d5a8-2f7a-42c0-a6a0-567f12aa0eb8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:48.970286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-5d55cbe1-d127-4452-9b29-f0264fcb3f17 req-7ff1d5a8-2f7a-42c0-a6a0-567f12aa0eb8 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:49.025143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-5d55cbe1-d127-4452-9b29-f0264fcb3f17 req-7ff1d5a8-2f7a-42c0-a6a0-567f12aa0eb8 service nova] Creating event network-changed:7e6adc77-9fc4-4658-9d15-0c9d656d3797 for instance 475e333a-a670-43c9-b18b-251a960ede71 on hv-cinder-84773 Sep 06 20:18:49.035392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-5d55cbe1-d127-4452-9b29-f0264fcb3f17 req-7ff1d5a8-2f7a-42c0-a6a0-567f12aa0eb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101398 Sep 06 20:18:49.036894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 220/463] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:18:49.682453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:49.683491 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:49.696279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:49.696921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:49.697585 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:49.698904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:49.699746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:49.700525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:49.942386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:49.959472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:49.962490 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:49.964864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f7d8a2c2-e341-45a3-85da-35661b3a1092 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1721 microversion: 2.20 time: 0.287361 Sep 06 20:18:49.966376 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 244/464] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:49 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:51.020125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:51.020125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:51.041880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:51.043164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:51.044805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:51.046171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:51.048725 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:51.050074 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:51.320228 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:51.340530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:51.343906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:51.346648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5dc28ca0-1dcf-405a-aa1b-799a207a0b22 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1721 microversion: 2.20 time: 0.339555 Sep 06 20:18:51.347868 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 221/465] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:51 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:52.385469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:52.389592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:52.415274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:52.418510 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:52.419261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:52.423572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:52.424521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:52.425241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:52.671011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:52.693236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:52.698120 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:52.700878 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-887b425e-6837-4b13-9c55-26cdc21eef08 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1721 microversion: 2.20 time: 0.323453 Sep 06 20:18:52.701755 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 245/466] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:52 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1721 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:53.742669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:53.743565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:53.757064 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:53.758589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:53.760419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:53.762570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:53.764094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:53.766614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:54.147443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:54.160082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:54.162461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:54.163816 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a02b7118-e620-4d4c-94b4-bacc33ad8749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1724 microversion: 2.20 time: 0.431827 Sep 06 20:18:54.173693 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 222/467] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:53 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:54.202041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6f849bc-f8e1-4960-9600-94dc94c0ebce"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:54.206077 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:54.214864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:54.215362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:54.216154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:54.216896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:54.217370 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:54.217857 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:54.224374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:54.804286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f0890b9c-3223-4145-a72c-64f5c08edf47 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.608163 Sep 06 20:18:54.806015 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 246/468] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Sep 6 20:18:54 2022] POST /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments => generated 188 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:18:54.999563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:55.001927 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:55.014019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:55.015803 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:55.016831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:55.018199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:55.019252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:55.020037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:55.109797 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120951) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 20:18:55.209988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-af0f55a4-2d87-4059-9151-fc084227e831 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/action" status: 202 len: 0 microversion: 2.20 time: 0.217664 Sep 06 20:18:55.211060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 223/469] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 20:18:54 2022] POST /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:18:55.223447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:55.225691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:55.236182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:55.236850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:55.237728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:55.239268 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:55.240104 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:55.240869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:55.503849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:55.520511 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:55.522572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:55.524047 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f45bafff-18ef-4fe2-b153-0f8891f4748f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.308046 Sep 06 20:18:55.524767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 247/470] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:55 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:56.568328 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:56.569019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:56.576236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:56.576872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:56.577456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:56.578865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:56.579502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:56.580046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:56.808599 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:56.820549 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:56.822331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:56.824535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fe43ca93-077f-46d8-8c4a-5d2f365f14ac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.262353 Sep 06 20:18:56.825256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 224/471] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:56 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:18:57.868396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:57.869111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:57.878164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:57.879101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:57.880032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:57.881378 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:57.882341 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:57.883100 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:58.105770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:58.117116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:58.119029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:58.120301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-cd43dd4b-40cf-4dfa-b7dc-d096154cae3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.256283 Sep 06 20:18:58.120871 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 248/472] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:57 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:18:58.663619 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1593942172", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "networks": [{"uuid": "8f99d2a5-aeb3-4a94-8d0f-224d189c20c0"}]}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:18:59.146875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:18:59.147795 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:18:59.160504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:59.161891 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:59.162763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:59.164038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:18:59.165806 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:18:59.166590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:18:59.412070 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:59.427153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:59.430760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:18:59.433569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-92be3246-2efd-488c-83b7-866256db4b55 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.290732 Sep 06 20:18:59.435765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 249/473] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:18:59 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:00.476837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:00.478285 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:00.482761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:00.493221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:00.494001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:00.494713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:00.495562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:00.496097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:00.496755 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:00.683115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:00.695441 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:00.697182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:00.698569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2cee5c06-d2d2-44d1-9a26-54d7578b7546 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.230326 Sep 06 20:19:00.699202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 250/474] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:00 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:01.742413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:01.743132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:01.752203 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:01.753240 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:01.753729 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:01.754641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:01.755107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:01.755545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:01.930382 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:01.940824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:01.942611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:01.943980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d50c4df2-50cd-4930-b298-6f318261eb95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.206636 Sep 06 20:19:01.944620 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 251/475] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:01 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:02.971804 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:02.972675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:02.979534 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:02.980034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:02.980477 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:02.981192 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:02.981678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:02.982115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:03.168531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:03.178629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:03.180168 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:03.181394 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1015db21-031e-4b74-b7bb-03c704745fee tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.214191 Sep 06 20:19:03.182225 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 252/476] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:02 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:04.209140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:04.210989 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:04.222814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:04.223705 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:04.224512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:04.225872 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:04.226726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:04.227521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:04.430204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:04.447131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:04.450521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:04.452887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5e3bd047-db45-4108-8c56-6c019cdce35f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.247651 Sep 06 20:19:04.454021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 253/477] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:04 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:05.484706 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:05.486300 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:05.495185 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:05.495836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:05.496365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:05.497392 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:05.497893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:05.498379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:05.699201 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:05.711560 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:05.713145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:05.714335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-74d3fb18-5445-4106-8c81-c27f072b18e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.237285 Sep 06 20:19:05.714897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 254/478] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:05 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:06.743501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:06.744445 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:06.752027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:06.752525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:06.753018 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:06.753786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:06.754249 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:06.754671 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:06.814486 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:06.954373 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:06.964218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:06.965742 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:06.967007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fa4a150e-a4b6-43cf-a49d-7f87f247f347 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.228042 Sep 06 20:19:06.967619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 255/479] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:06 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:07.382522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] validate_networks() for [('8f99d2a5-aeb3-4a94-8d0f-224d189c20c0', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:19:07.994334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:07.995647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:08.011501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:08.013688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:08.016092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:08.016940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:08.020182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:08.021352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:08.064272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:19:08.065512 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:19:08.067534 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:19:08.068289 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:19:08.069489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:19:08.090139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:08.091065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:08.092719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:08.095217 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:08.096636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:08.097874 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:08.136877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Getting quotas for project b5de971d8037434fbaf3c5aa93729028. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:19:08.143458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Getting quotas for user 87f8cc79586f4cb79c962ede8342f580 and project b5de971d8037434fbaf3c5aa93729028. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:19:08.163699 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:19:08.167614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:19:08.264336 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fa5f2cbd-945c-4a36-9dd9-68af969cc46b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.605094 Sep 06 20:19:08.265035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 225/480] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 9607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 20:19:08.291494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fdcc64b7-ebd1-4c35-ad1d-84907538db17 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:08.292181 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fdcc64b7-ebd1-4c35-ad1d-84907538db17 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:08.399215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fdcc64b7-ebd1-4c35-ad1d-84907538db17 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:08.419606 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fdcc64b7-ebd1-4c35-ad1d-84907538db17 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1219 microversion: 2.1 time: 0.135993 Sep 06 20:19:08.421935 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 226/481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:08 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:08.472282 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:08.488192 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:08.490568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:08.492344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a49e9e7b-266e-4343-8f0d-6c13cdac60e8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1750 microversion: 2.20 time: 0.503136 Sep 06 20:19:08.493328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 256/482] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:07 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1750 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:09.461594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:09.462905 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:09.489112 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:09.490303 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:09.491284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:09.492282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:09.494827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:09.495515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:09.533499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:09.534396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:09.553960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:09.567433 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:09.569574 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:09.572819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:09.574034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:09.574971 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:09.657652 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:09.680203 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-72b54c30-c0e5-4046-91b5-ee449b351516 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1271 microversion: 2.1 time: 0.222772 Sep 06 20:19:09.681270 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 227/483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:09 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:09.896255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:09.946942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:09.948882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:09.960776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0c7c1f46-21af-4126-91b6-5bbeb2a968ad tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1752 microversion: 2.20 time: 0.426966 Sep 06 20:19:09.964933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 257/484] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:09 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1752 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:10.721847 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:10.726808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:10.742800 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:10.745215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:10.746281 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:10.748146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:10.749942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:10.751121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:10.921111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:10.931225 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6ab84185-918b-4b89-aa85-e9c70b547414 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1277 microversion: 2.1 time: 0.217258 Sep 06 20:19:10.946337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 228/485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:10 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:11.015759 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:11.016957 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:11.030590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:11.031725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:11.032650 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:11.034357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:11.035243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:11.036166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:11.263210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:11.280358 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:11.288552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:11.289840 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f8d6486a-22e0-4bbd-abb4-92370ef7caef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1752 microversion: 2.20 time: 0.284084 Sep 06 20:19:11.297992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 258/486] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:11 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1752 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:11.958740 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:11.960412 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:11.972204 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:11.973058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:11.973860 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:11.975103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:11.976080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:11.976704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:12.344028 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:12.344344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:12.345565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:12.360636 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:12.361763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-38c2f741-1ccb-440e-9015-cf5c01848013 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.408524 Sep 06 20:19:12.361963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:12.363362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:12.365097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:12.366239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:12.367237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:12.374314 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 229/487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:11 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:12.693769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:12.711856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:12.715100 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:12.717572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e305d989-bc7d-42dd-be00-4daaaa1b2f9c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.382884 Sep 06 20:19:12.735408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 259/488] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:12 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:13.390918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:13.391677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:13.409084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:13.409702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:13.410138 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:13.410905 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:13.411399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:13.419596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:13.506565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-d18a7755-5830-4a84-857f-89977dca2882 req-b396496f-fb38-4bbb-94ed-13ab410fd4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84150d05-acce-4f9a-87cd-5ec3ce987386", "tag": "eb12f874-144e-4f2d-9e2b-20c1290bd4f5"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:13.527987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-d18a7755-5830-4a84-857f-89977dca2882 req-b396496f-fb38-4bbb-94ed-13ab410fd4bb service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:13.529368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-d18a7755-5830-4a84-857f-89977dca2882 req-b396496f-fb38-4bbb-94ed-13ab410fd4bb service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:13.530502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-d18a7755-5830-4a84-857f-89977dca2882 req-b396496f-fb38-4bbb-94ed-13ab410fd4bb service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:13.539245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:13.557702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-d18a7755-5830-4a84-857f-89977dca2882 req-b396496f-fb38-4bbb-94ed-13ab410fd4bb service nova] Creating event network-changed:eb12f874-144e-4f2d-9e2b-20c1290bd4f5 for instance 84150d05-acce-4f9a-87cd-5ec3ce987386 on hv-cinder-84773 Sep 06 20:19:13.569194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-d18a7755-5830-4a84-857f-89977dca2882 req-b396496f-fb38-4bbb-94ed-13ab410fd4bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070882 Sep 06 20:19:13.570801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 260/489] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:19:13.762196 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:13.771674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2fbd30cc-4155-4b3b-ba16-c93210bb84dc tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.387713 Sep 06 20:19:13.772269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 230/490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:13 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:13.773930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:13.775176 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:13.797295 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:13.798636 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:13.799410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:13.801837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:13.802785 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:13.803541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:14.056649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:14.074107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:14.078417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:14.080996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2f0d01aa-69d9-4967-bafe-df25b1ff045c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.318831 Sep 06 20:19:14.082814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 261/491] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:13 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:14.816249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:14.818479 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:14.830066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:14.830844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:14.831654 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:14.833278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:14.834458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:14.835448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:15.102145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:15.115761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:15.118032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:15.118411 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-636f1a27-8841-4881-8774-0323ffe1c896 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.309752 Sep 06 20:19:15.127893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 231/492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:14 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:15.132788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:15.133811 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:15.134726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:15.135775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:15.136448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:15.137033 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:15.383819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:15.414384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:15.419011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:15.421333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8ba1ff89-1598-45e7-bdca-cc057295f6d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.313421 Sep 06 20:19:15.423099 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 262/493] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:15 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:16.157563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:16.158692 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:16.166837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:16.167800 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:16.168282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:16.169149 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:16.169947 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:16.170389 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:16.452080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:16.463715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-50bbf729-437a-4c86-8126-fa9d19268118 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.310403 Sep 06 20:19:16.464945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 232/494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:16 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:16.468847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:16.470270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:16.490775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:16.491340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:16.492071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:16.492836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:16.494146 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:16.494299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:16.884923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:16.906452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:16.911538 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:16.914913 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b69e397a-8191-4800-bdd9-144bf8f2becb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.452513 Sep 06 20:19:16.916807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 263/495] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:16 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:17.497218 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:17.499227 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:17.511505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:17.512365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:17.513165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:17.514578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:17.515931 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:17.516771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:17.843206 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:17.856848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0ab3570e-04d1-40b1-95c3-24e9343f29aa tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.368487 Sep 06 20:19:17.860218 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 233/496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:17 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:17.949729 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:17.951348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:17.977564 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:17.987001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:17.987973 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:17.989579 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:17.991523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:17.992339 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:18.223866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-530045439", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-384168834", "security_groups": [{"name": "tempest-secgroup-smoke-873006765"}], "networks": [{"uuid": "900c31ae-039e-40a6-b46e-2a56b907e04f"}], "block_device_mapping_v2": [{"uuid": "aa74fd14-d7cc-4756-85a4-82d92a7b8b86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:18.259561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:18.365643 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:18.409246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=8 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:18.418851 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:18.427061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:18.434035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-64854468-c4b7-4aa2-bccf-f21e2dfac843 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.490962 Sep 06 20:19:18.439186 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 264/497] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:17 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:18.659559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] validate_networks() for [('900c31ae-039e-40a6-b46e-2a56b907e04f', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:19:18.915792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:18.917417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:18.947866 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:18.949165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:18.951770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:18.955710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:18.956905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:18.958039 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:19.016412 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:19.390816 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:19.425125 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8f251750-4a16-4106-b036-9c8249873357 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.520941 Sep 06 20:19:19.431106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 265/498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:18 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:19.507072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:19.508199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:19.529709 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:19.530666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:19.532014 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:19.533835 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:19.534767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:19.535492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:19.647407 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:19:19.647822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:19:19.648667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:19:19.649529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:19:19.650615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:19:19.690370 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:19.698719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:19.699902 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:19.707686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:19.711125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:19.715144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:19.838354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Getting quotas for project b030ea0d617b4583a2397921c884aaa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:19:19.864417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Getting quotas for user aaa686e692444eae835ca343926e0595 and project b030ea0d617b4583a2397921c884aaa5. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:19:20.025914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:20.064053 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:20.074119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:20.075817 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:19:20.080541 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa74fd14-d7cc-4756-85a4-82d92a7b8b86',volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:19:20.081554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c02e2400-f36a-4753-b3ba-3ee866949430 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.573915 Sep 06 20:19:20.097820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 266/499] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:19 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:20.440769 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3326932b-0243-4574-b7d7-46904b470507 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.225730 Sep 06 20:19:20.448704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 234/500] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:19:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 2235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:19:20.455227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:20.455485 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ab61f0d5-2145-4678-8503-ee91688f88bd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:20.455905 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ab61f0d5-2145-4678-8503-ee91688f88bd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:20.456644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:20.470846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:20.474175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:20.475112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:20.476220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:20.476927 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:20.479951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:20.544317 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ab61f0d5-2145-4678-8503-ee91688f88bd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:20.556936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ab61f0d5-2145-4678-8503-ee91688f88bd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1087 microversion: 2.1 time: 0.106679 Sep 06 20:19:20.557648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 235/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:20 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1087 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:20.757286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:20.774068 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-96c5cc02-4b9c-43fb-906f-7cb43b877468 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.324525 Sep 06 20:19:20.775210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 267/502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:20 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:21.141572 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:21.143657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:21.152356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:21.153022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:21.153543 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:21.154400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:21.154964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:21.155486 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:21.345900 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:21.363446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:21.366570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:21.368745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6bb87713-03eb-4bca-aca7-c94549e5b2f4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.231974 Sep 06 20:19:21.369813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 236/503] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:21 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:21.596056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:21.596662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:21.603825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:21.604359 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:21.604802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:21.605531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:21.606075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:21.606546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:21.717305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:21.727638 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-41774779-f329-4cda-af99-e847dc8631d7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.137333 Sep 06 20:19:21.730967 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 268/504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:21 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:21.816868 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:21.817378 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:21.826439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:21.827047 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:21.827592 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:21.828893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:21.829385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:21.829991 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:22.054952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:22.065050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6c80c670-d407-4de5-9e59-c7a49db66623 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.253407 Sep 06 20:19:22.066995 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 237/505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:21 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:22.401065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:22.401924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:22.409947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:22.410446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:22.410893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:22.411624 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:22.412088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:22.412545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:22.651194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:22.665256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:22.667047 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:22.668569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8b3b0cae-a1aa-4287-a43d-f5171ca84f25 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.272838 Sep 06 20:19:22.669255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 269/506] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:22 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:22.757811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:22.760191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:22.773726 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:22.775018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:22.776030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:22.778090 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:22.779188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:22.780212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:22.871407 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:22.885237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c759ae87-f359-4cb3-ab39-a06dd3f9ec89 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.134391 Sep 06 20:19:22.886425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 238/507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:22 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:23.117757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:23.118731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:23.131842 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:23.132778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:23.133533 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:23.135033 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:23.136290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:23.137385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:23.410858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:23.435153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e9bdd38a-3276-49f1-8a78-e6b6562f802f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.325548 Sep 06 20:19:23.441430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 270/508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:23 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:23.705588 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:23.706423 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:23.718680 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:23.719723 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:23.721429 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:23.722564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:23.723783 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:23.725115 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:23.925004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:23.941306 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:23.974876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:23.975827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:23.978702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:23.980386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:23.981357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:23.982382 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:24.081741 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:24.126347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:24.137604 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:24.142493 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:24.144393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bb2e79cf-415c-4d8e-96c4-64355ef09368 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.444605 Sep 06 20:19:24.147779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 239/509] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:23 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:24.184887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8c31fc0a-4240-4635-88c3-85a2edcfb16c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.267999 Sep 06 20:19:24.202265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 271/510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:23 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:24.479474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:24.480578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:24.490289 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:24.491144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:24.491717 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:24.492608 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:24.493166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:24.493829 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:24.787391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:24.808502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d06c5740-7e5a-4c87-98ae-35cbb7489fea tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.335727 Sep 06 20:19:24.826101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 240/511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:24 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:25.188960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:25.189756 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:25.196774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:25.197368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:25.197857 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:25.198594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:25.199060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:25.199489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:25.236199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:25.237154 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:25.249445 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:25.250046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:25.250498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:25.251269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:25.251745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:25.252181 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:25.351391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:25.362300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-14b7c1aa-cc34-436e-87cb-056b22360428 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.140398 Sep 06 20:19:25.363069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 241/512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:25 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:25.388041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:25.397813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:25.399326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:25.400574 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c1109015-a2f5-4fab-9746-31d6750a8255 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.215891 Sep 06 20:19:25.401206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 272/513] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:25 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:25.855122 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:25.856281 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:25.867840 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:25.868720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:25.869497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:25.870751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:25.871726 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:25.872312 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:26.029833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:26.038738 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5a556229-294d-4883-8fb9-1fdfee0f6283 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.190967 Sep 06 20:19:26.039582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 242/514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:25 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:26.390237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:26.390971 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:26.398137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:26.398643 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:26.399140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:26.399862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:26.400315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:26.400743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:26.431794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:26.432878 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:26.443178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:26.443673 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:26.444144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:26.444856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:26.445546 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:26.446010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:26.491046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:26.499482 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c083f5cf-7682-487b-a28a-8b805291f744 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.113740 Sep 06 20:19:26.500153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 273/515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:26 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:26.631631 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:26.648845 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:26.651793 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:26.654304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2c5aabb6-285f-4007-92ef-0150cd2dd571 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.229927 Sep 06 20:19:26.655331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 243/516] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:26 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:27.064772 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:27.065696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:27.073824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:27.074391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:27.074979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:27.075811 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:27.076317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:27.076881 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:27.249891 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:27.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2f827a73-8ca8-4e5f-bdd6-5c1f8dfadf27 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.203959 Sep 06 20:19:27.265930 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 274/517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:27 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:27.524656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:27.525357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:27.533267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:27.533802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:27.534237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:27.534989 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:27.535409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:27.535830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:27.613166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:27.617053 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:27.622980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d0a896ca-43b4-4d23-a31c-5ff7b6c4a882 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.103601 Sep 06 20:19:27.623569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 244/518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:27 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:27.698135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:27.698937 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:27.707270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:27.707766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:27.708205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:27.708932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:27.709386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:27.709847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:27.928175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:27.952351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:27.958619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:27.960596 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-947f0e4f-6eb6-40d6-90ee-c5cade482acc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.267203 Sep 06 20:19:27.961584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 275/519] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:27 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:28.302764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:28.303299 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:28.310309 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:28.310889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:28.311353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:28.312068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:28.313139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:28.313580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:28.523874 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:28.540285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-dcede79d-577a-443e-a441-a921ac96e266 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.241465 Sep 06 20:19:28.541406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 245/520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:28 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:28.654009 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:28.655121 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:28.666310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:28.667131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:28.667887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:28.669129 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:28.670002 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:28.670756 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:28.747919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:28.762439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-585f8eb7-62ed-463e-9f2e-eafe554c5f8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.115588 Sep 06 20:19:28.763461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 276/521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:28 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:28.988688 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:28.990024 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:28.997930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:28.998842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:28.999371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:29.000476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:29.001194 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:29.001587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:29.232362 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:29.273765 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:29.279233 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:29.288579 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-76986773-3c4f-423a-8da6-cfcaeb30bac0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.298828 Sep 06 20:19:29.289381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 246/522] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:28 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:29.586577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:29.587676 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:29.597039 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:29.597701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:29.598186 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:29.599065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:29.599641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:29.600150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:29.630165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:29.803206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:29.808864 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:29.809980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:29.813445 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-90af1108-deea-42a7-a265-bbfca41bdd3e tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.233072 Sep 06 20:19:29.814092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 277/523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:29 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:29.814288 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:29.824831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:29.825797 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:29.826593 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:29.827937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:29.828820 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:29.829521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:29.933823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:29.943069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b84a19dc-3088-45b7-bc12-5a2af4376332 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1137 microversion: 2.1 time: 0.142890 Sep 06 20:19:29.943694 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 247/524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:29 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1137 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:30.332320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:30.333199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:30.340383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:30.340983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:30.341467 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:30.342661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:30.343145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:30.343693 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:30.522749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:30.533385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:30.535421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:30.536808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9b75e029-a3a4-4b41-bd93-740f945d170d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.209365 Sep 06 20:19:30.537388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 278/525] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:30 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:30.850488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:30.851177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:30.853373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=8 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:30.859334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:30.859833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:30.860300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:30.861046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:30.861527 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:30.862031 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:30.977488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:30.978605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:30.981071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=58 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:30.989430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:30.990100 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:30.990659 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:30.991573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:30.992234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:30.992777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:31.052716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:31.069474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-08070210-7c52-4bcf-b2a1-a7a813ad988c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.222734 Sep 06 20:19:31.071132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 248/526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:30 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:31.073826 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:31.084994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-30dbd5bf-c45d-449e-af08-f4726c490ae2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1185 microversion: 2.1 time: 0.112480 Sep 06 20:19:31.086635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 279/527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:30 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:31.584283 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:31.584679 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:31.591955 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:31.592471 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:31.593001 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:31.593662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:31.594133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:31.594553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:31.780770 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:31.794614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:31.796104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:31.797886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7cbfbfc1-a555-44b7-bd0f-2d38436f69cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.220996 Sep 06 20:19:31.798458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 249/528] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:31 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:32.098690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:32.099798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:32.108096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.108763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.109899 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:32.111055 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.111733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.112302 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:32.124875 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:32.126064 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:32.134934 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.135713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.136348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:32.137409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.138267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.139011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:32.233873 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:32.247593 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ac6b0bee-d0c1-46d4-9194-4f8df0e90e8a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1185 microversion: 2.1 time: 0.126586 Sep 06 20:19:32.248460 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 250/529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:32 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:32.347991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:32.357869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-82944425-89da-496f-8cf4-cf1f19b863bb tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.264582 Sep 06 20:19:32.358725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 280/530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:32 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:32.824505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:32.825070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:32.832691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.833339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.833921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:32.834934 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.835430 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.835902 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:32.944126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b616e49-5605-411c-b77c-6b8dd7b4203c"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:32.949031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:32.959147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.960037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.960841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:32.962138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:32.962997 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:32.963860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:33.138133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:33.148664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:33.150849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:33.152483 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b0fe6e88-e6f4-4bf6-9024-2a82290511d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.332258 Sep 06 20:19:33.154041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 251/531] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:32 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:33.283099 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:33.284265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:33.295187 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:33.296036 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:33.297115 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:33.298249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:33.299035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:33.300011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:33.426473 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:33.443052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-37d10baf-c5aa-4eda-bb88-2d61043c27f6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1185 microversion: 2.1 time: 0.166651 Sep 06 20:19:33.443796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a37f0f07-ceac-4f7b-b6b6-5ec63842065c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507898 Sep 06 20:19:33.444567 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 252/532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:33 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:33.445098 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 281/533] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:19:32 2022] POST /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:19:33.452079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:33.453839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:33.476667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:33.477627 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:33.478426 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:33.479531 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:33.480012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:33.480442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:33.650631 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:33.660203 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-96f00d66-340b-4118-9676-9564291ae68c tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.214565 Sep 06 20:19:33.660808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 253/534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:33 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:34.198361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:34.199199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:34.206734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:34.207235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:34.207682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:34.208453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:34.208924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:34.209358 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:34.380388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:34.390711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:34.392348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:34.393865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-cfbe1588-b9e3-4fba-ad22-c8bf6feaae68 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.201245 Sep 06 20:19:34.394455 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 282/535] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:34 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:34.470234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:34.471213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:34.482524 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:34.483355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:34.484088 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:34.485377 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:34.486279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:34.487121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:34.609814 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:34.624698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a2d50e9b-d726-470f-bfcd-8a4f6db686e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1203 microversion: 2.1 time: 0.159247 Sep 06 20:19:34.626277 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 254/536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:34 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:34.685879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:34.686787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:34.695545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:34.696148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:34.696590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:34.697329 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:34.697877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:34.698517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:34.893698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:34.918336 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6e8afaf1-4ce9-4a66-9c77-fb78def255a1 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.236284 Sep 06 20:19:34.920216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 283/537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:34 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:35.378449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-223f8a4c-b54f-4fed-9c27-5e7fb2e4507e req-b29f38e6-6bc1-4d52-935f-378cd95cae60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84150d05-acce-4f9a-87cd-5ec3ce987386", "name": "network-vif-plugged", "status": "completed", "tag": "eb12f874-144e-4f2d-9e2b-20c1290bd4f5"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:35.397571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-223f8a4c-b54f-4fed-9c27-5e7fb2e4507e req-b29f38e6-6bc1-4d52-935f-378cd95cae60 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:35.399360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-223f8a4c-b54f-4fed-9c27-5e7fb2e4507e req-b29f38e6-6bc1-4d52-935f-378cd95cae60 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:35.400177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-223f8a4c-b54f-4fed-9c27-5e7fb2e4507e req-b29f38e6-6bc1-4d52-935f-378cd95cae60 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:35.420273 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-223f8a4c-b54f-4fed-9c27-5e7fb2e4507e req-b29f38e6-6bc1-4d52-935f-378cd95cae60 service nova] Creating event network-vif-plugged:eb12f874-144e-4f2d-9e2b-20c1290bd4f5 for instance 84150d05-acce-4f9a-87cd-5ec3ce987386 on hv-cinder-84773 Sep 06 20:19:35.429665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-223f8a4c-b54f-4fed-9c27-5e7fb2e4507e req-b29f38e6-6bc1-4d52-935f-378cd95cae60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056276 Sep 06 20:19:35.430364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:35.431459 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 255/538] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:19:35.431972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:35.445018 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:35.446020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:35.447526 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:35.449251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:35.450447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:35.451827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:35.664677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:35.666014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:35.690414 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:35.694381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:35.696026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:35.697792 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:35.699580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:35.701402 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:35.762080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:35.781428 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:35.785918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:35.788365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-617b47c4-0e91-4b71-8ed2-59a5d1a5f0fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.367779 Sep 06 20:19:35.789584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 284/539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:35 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:35.949849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:35.950669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:35.959944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:35.960468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:35.960964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:35.961823 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:35.962408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:35.962851 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:36.107291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:36.117454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-845f0240-4bc5-4bf6-9e41-ae9cc891d7b3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1270 microversion: 2.1 time: 0.462636 Sep 06 20:19:36.118392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 256/540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:35 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1270 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:36.210464 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:36.219573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a2ba64a6-8f5c-4100-9900-890da59edb78 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.276609 Sep 06 20:19:36.234006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 285/541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:35 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:36.704749 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-fd86aaf3-f6f6-4df8-bc4b-eb310a7efad5 req-5c80000a-6762-44f2-bb4e-429c0451c557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d46c6a-bba3-4e7e-ab96-f22796eee28e", "tag": "58da1786-9578-4fdc-816f-0dacca3e7184"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:36.717136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-fd86aaf3-f6f6-4df8-bc4b-eb310a7efad5 req-5c80000a-6762-44f2-bb4e-429c0451c557 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:36.717659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-fd86aaf3-f6f6-4df8-bc4b-eb310a7efad5 req-5c80000a-6762-44f2-bb4e-429c0451c557 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:36.718097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-fd86aaf3-f6f6-4df8-bc4b-eb310a7efad5 req-5c80000a-6762-44f2-bb4e-429c0451c557 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:36.734034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-fd86aaf3-f6f6-4df8-bc4b-eb310a7efad5 req-5c80000a-6762-44f2-bb4e-429c0451c557 service nova] Creating event network-changed:58da1786-9578-4fdc-816f-0dacca3e7184 for instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e on hv-cinder-84773 Sep 06 20:19:36.741296 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-fd86aaf3-f6f6-4df8-bc4b-eb310a7efad5 req-5c80000a-6762-44f2-bb4e-429c0451c557 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041113 Sep 06 20:19:36.742455 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 257/542] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:19:36.834523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:36.835567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:36.843021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:36.844370 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:36.844975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:36.845847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:36.846362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:36.846891 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:37.057012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:37.068004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:37.069962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:37.071468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c8955e82-3e3a-4c7b-b4ee-deb096d15cca tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.242351 Sep 06 20:19:37.072118 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 286/543] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:36 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:37.159665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:37.160503 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:37.167388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:37.167913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:37.168351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:37.169076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:37.169533 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:37.169998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:37.245545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:37.246590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:37.255027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:37.255743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:37.256263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:37.257103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:37.257671 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:37.258197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:37.351478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:37.360619 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-13ff2437-51ae-4559-a2e4-b78208f325f2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1270 microversion: 2.1 time: 0.205569 Sep 06 20:19:37.361242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 258/544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:37 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:37.463506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:37.479667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-209a15d4-60ea-4ac8-b99f-6beff5fb9123 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1319 microversion: 2.1 time: 0.238221 Sep 06 20:19:37.480726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 287/545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:37 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:38.102780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:38.103723 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:38.111693 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.112206 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.112678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:38.113488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.113987 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.114409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:38.290844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:38.309326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:38.313107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:38.315252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f8c12a6f-014d-4cd2-87d6-6376bc269698 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.219391 Sep 06 20:19:38.316141 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 259/546] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:38 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:38.387577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:38.388477 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:38.395595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.396229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.396666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:38.397401 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.397896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.398327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:38.522127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:38.523234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:38.532996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.533956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.534767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:38.536422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.537274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.538076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:38.630384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:38.648263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6bfc9a0c-60e7-4e18-aeec-bb689761f1c5 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1270 microversion: 2.1 time: 0.264553 Sep 06 20:19:38.649284 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 288/547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:38 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1270 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:38.761647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:38.771715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3aa0890d-e46e-47fc-8481-4cf74096306d tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1508 microversion: 2.1 time: 0.254038 Sep 06 20:19:38.772712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 260/548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:38 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:38.816516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5f530e4-c0ed-4c9e-bb2c-557822620e31", "device": "/dev/sdb"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:38.821180 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:38.832210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.833114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.837962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:38.839344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:38.840144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:38.840880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:39.241970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:39.243431 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:39.251692 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:39.252616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:39.253414 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:39.254491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:39.255655 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:39.256521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:39.358411 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a3a699d0-3c38-4d22-9f92-c8d3225ae164 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "POST /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550408 Sep 06 20:19:39.360476 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 289/549] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:19:38 2022] POST /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386/os-volume_attachments => generated 194 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:19:39.399004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:39.403921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:39.435205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:39.436811 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:39.437567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:39.439256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:39.440545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:39.441695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:39.486925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lazy-loading 'services' on Instance uuid 22f25258-270e-479e-b6d2-5dc39da2f3a5 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:19:39.681981 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-25b0c81d-783d-41ce-9e33-528081332591 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-volume_attachments/7ca307d6-8273-4733-9313-61ed74065d57" status: 202 len: 0 microversion: 2.1 time: 0.443982 Sep 06 20:19:39.688307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 261/550] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:19:39 2022] DELETE /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-volume_attachments/7ca307d6-8273-4733-9313-61ed74065d57 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:19:39.695400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:39.697040 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:39.715629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:39.716921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:39.718057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:39.723442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:39.724698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:39.725132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:39.726021 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:39.737351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:39.743034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:39.746232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:39.748418 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7104bead-9d36-4cb9-a5a8-a27972809ea0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.386329 Sep 06 20:19:39.750356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 290/551] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:39 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:39.999357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:40.011704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ce869d97-6700-486d-8ba6-98b9ee81e695 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1270 microversion: 2.1 time: 0.326301 Sep 06 20:19:40.012515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 262/552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:39 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1270 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:40.812218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:40.814977 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:40.827643 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:40.828924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:40.829999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:40.831268 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:40.832063 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:40.833843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:40.867832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:41.041894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:41.043150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:41.053867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:41.054965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:41.055833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:41.073564 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:41.075005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:41.075671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:41.076291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:41.103089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:41.111559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:41.119001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f1e6ba18-8f31-4745-8896-87255979fcac tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.314854 Sep 06 20:19:41.134725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 291/553] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:40 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:41.370097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:41.370097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3e236ef9-5d0d-4de6-b0cb-bfa3cb5ab0f4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1270 microversion: 2.1 time: 0.331162 Sep 06 20:19:41.370097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 263/554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:41 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1270 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:41.426052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:41.430317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:41.440658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:41.441476 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:41.442300 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:41.443599 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:41.444492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:41.445157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:41.486528 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lazy-loading 'flavor' on Instance uuid 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:19:41.623348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-3e5cd67a-a045-4bd1-bd5f-a9c8197a0c88 req-6cf5d292-7aae-48ed-9bb6-e2c75cacfb4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f6b5ee-95cf-4e73-8124-578bcbcd7c19", "name": "network-vif-plugged", "status": "completed", "tag": "9eaa793d-1594-4913-b5c0-8b0669ff04be"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:41.646511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-3e5cd67a-a045-4bd1-bd5f-a9c8197a0c88 req-6cf5d292-7aae-48ed-9bb6-e2c75cacfb4b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:41.647449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-3e5cd67a-a045-4bd1-bd5f-a9c8197a0c88 req-6cf5d292-7aae-48ed-9bb6-e2c75cacfb4b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:41.648009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-3e5cd67a-a045-4bd1-bd5f-a9c8197a0c88 req-6cf5d292-7aae-48ed-9bb6-e2c75cacfb4b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:41.671597 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-3e5cd67a-a045-4bd1-bd5f-a9c8197a0c88 req-6cf5d292-7aae-48ed-9bb6-e2c75cacfb4b service nova] Creating event network-vif-plugged:9eaa793d-1594-4913-b5c0-8b0669ff04be for instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 on hv-cinder-84773 Sep 06 20:19:41.681751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-3e5cd67a-a045-4bd1-bd5f-a9c8197a0c88 req-6cf5d292-7aae-48ed-9bb6-e2c75cacfb4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081946 Sep 06 20:19:41.683254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 264/555] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:19:41.813443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8019286b-de3f-4979-bf8b-702de678f487 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/action" status: 200 len: 32 microversion: 2.1 time: 0.394036 Sep 06 20:19:41.814530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 292/556] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:19:41 2022] POST /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/action => generated 32 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 20:19:41.830379 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:41.831268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:41.841449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:41.841971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:41.842408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:41.843121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:41.844138 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:41.844570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:42.084432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:42.100411 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-959195aa-ff06-46fb-9aeb-ec86c40d5cea tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.275880 Sep 06 20:19:42.101497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 265/557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:41 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:42.175483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:42.176918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:42.194661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:42.195200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:42.195547 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:42.196452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:42.196864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:42.197684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:42.430242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:42.431724 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:42.432711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:42.462279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:42.467843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:42.471502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:42.474478 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-52a5cf1c-c230-4481-ba7a-4a9e41c6bffd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.307440 Sep 06 20:19:42.475732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 293/558] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:42 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:42.495093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:42.499121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:42.502168 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:42.503709 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:42.504382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:42.801715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:42.812916 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e4aaf449-95e7-4a8b-9c8b-e45146d40721 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.394936 Sep 06 20:19:42.813520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 266/559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:42 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:43.144977 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:43.146077 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:43.181024 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:43.181917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:43.182702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:43.183996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:43.184830 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:43.185879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:43.448415 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:43.459891 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5cf50d28-a0da-45e9-a5c2-d0b56c7b8b1d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.324299 Sep 06 20:19:43.460715 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 294/560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:43 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:43.526375 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:43.527246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:43.534260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:43.534736 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:43.535171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:43.535939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:43.536341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:43.536826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:43.841093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:43.842130 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:43.852848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:43.853690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:43.854417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:43.855649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:43.856406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:43.857111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:44.035648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:44.050529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:44.053755 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:44.056176 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8db77cf5-c9af-4a82-8096-d21a824182d2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.535026 Sep 06 20:19:44.057523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 267/561] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:43 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:19:44.097896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:44.106956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2f03d8a0-a59a-4c6b-a319-9eb92ad71cdc tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.272801 Sep 06 20:19:44.107551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 295/562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:43 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:44.491322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:44.492636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:44.503241 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:44.503919 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:44.504570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:44.505388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:44.506007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:44.506529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:44.698176 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:44.709657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-cc435431-ebb2-4eb5-bfb6-5831d7ae8e6f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.228401 Sep 06 20:19:44.710949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 268/563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:44 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:45.097331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:45.098177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:45.105072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:45.105576 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:45.106046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:45.106782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:45.107245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:45.107692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:45.145976 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:45.147163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:45.158685 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:45.159189 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:45.159633 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:45.160360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:45.160822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:45.161246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:45.278666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:45.298643 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:45.302499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:45.305023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-474a155b-f62c-48d7-b6ee-0de6e82d1464 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.212019 Sep 06 20:19:45.306572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 296/564] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:45 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:45.347337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:45.367045 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a4ae1f93-eae7-4b19-aea0-83d3e9036930 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.224967 Sep 06 20:19:45.368480 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 269/565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:45 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:45.739929 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:45.740784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:45.750482 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:45.750995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:45.751486 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:45.752285 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:45.753046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:45.753548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:46.004159 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:46.016470 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b32008f9-6089-46c8-b95f-2a38777ff963 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.285334 Sep 06 20:19:46.018071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 297/566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:45 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:46.349461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:46.350751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:46.363931 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:46.364760 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:46.365535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:46.366841 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:46.367662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:46.368431 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:46.438139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:46.439796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:46.456018 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:46.456990 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:46.458408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:46.460408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:46.462488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:46.464176 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:46.687226 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:46.698294 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:46.700250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:46.701524 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fbf0a277-df18-41f1-a9fc-e67506856da6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1808 microversion: 2.20 time: 0.360182 Sep 06 20:19:46.702136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 270/567] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:46 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1808 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:46.766374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:46.776058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c116920c-3274-4eac-a984-e2a9b62b8e49 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.369934 Sep 06 20:19:46.776798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 298/568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:46 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:47.057719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:47.058594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:47.066004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:47.066720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:47.067299 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:47.068469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:47.069098 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:47.069734 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:47.243207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:47.253530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3834e1a2-a939-4f81-8700-3c19a2d58952 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.200368 Sep 06 20:19:47.269652 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 271/569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:47 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:47.753155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:47.755525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:47.767421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:47.768487 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:47.769268 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:47.770595 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:47.771411 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:47.772161 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:47.807417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:47.809662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:47.820182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:47.821505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:47.822405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:47.823701 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:47.824855 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:47.825695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:48.018867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:48.037216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:48.040658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:48.043191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-afb9f534-d1e4-4cbe-8df5-d2205be3a6f6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1795 microversion: 2.20 time: 0.298964 Sep 06 20:19:48.044301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 299/570] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:19:47 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1795 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:19:48.102447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:48.116777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-85110053-a8d6-47d2-835b-b807ef3ecb8d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.315482 Sep 06 20:19:48.117768 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 272/571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:47 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:48.287647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:48.288301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:48.296591 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:48.297764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:48.298249 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:48.299082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:48.299557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:48.300029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:48.533226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:48.549230 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ca4dcdb2-3e27-4109-8e29-795a98c41e6e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.265269 Sep 06 20:19:48.550284 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 300/572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:48 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:49.154792 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:49.155447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:49.158368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:49.164182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:49.164689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:49.165126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:49.165937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:49.166489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:49.166880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:49.325281 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:49.341447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4be65801-c8e1-4cb0-b37c-394c3bc0e906 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.190556 Sep 06 20:19:49.342511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 273/573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:49 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:49.577145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:49.578256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:49.588887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:49.589679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:49.590731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:49.591665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:49.592396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:49.593030 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:49.845300 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:49.856003 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9e039bca-60c1-414a-b6be-a39669827b81 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.285138 Sep 06 20:19:49.856692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 301/574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:49 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:50.381348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:50.382006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:50.389210 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:50.389744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:50.390191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:50.391520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:50.391989 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:50.392436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:50.562562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:50.577282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fdd081a1-f8f8-4896-8906-beecb3ec33dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.199918 Sep 06 20:19:50.579168 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 274/575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:50 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:50.885548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:50.886591 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:50.896644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:50.897440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:50.898143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:50.899354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:50.900145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:50.900858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:51.074763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:51.091678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d33f52db-3561-4077-9444-d99d36066c67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.213570 Sep 06 20:19:51.092700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 302/576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:50 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:51.606924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:51.608090 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:51.619827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:51.620753 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:51.621494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:51.622761 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:51.623587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:51.624339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:51.830064 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:51.839135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-afc5f2c7-07ff-4375-8097-6c49dadfba13 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.239887 Sep 06 20:19:51.839729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 275/577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:51 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:52.132027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:52.133088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:52.142117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:52.142770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:52.143093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:52.144068 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:52.144674 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:52.145108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:52.311212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:52.320450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-50a074ed-ee4c-4df5-8379-c7fe7fae3296 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.193459 Sep 06 20:19:52.321119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 303/578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:52 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:52.867750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:52.868476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:52.875967 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:52.876497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:52.876944 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:52.877720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:52.878188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:52.878636 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:53.083146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:53.104223 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c93446b7-2e84-49aa-9010-9f2b9ce7e855 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.241347 Sep 06 20:19:53.114487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 276/579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:52 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:53.347860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:53.348663 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:53.356648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:53.357222 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:53.357931 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:53.358859 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:53.359407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:53.359890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:53.564499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:53.574416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5937027a-76ba-4f0b-b2fb-ebd3b3c00a67 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.232265 Sep 06 20:19:53.575012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 304/580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:53 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:54.153492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:54.154807 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:54.170696 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:54.172067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:54.173034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:54.174599 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:54.175357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:54.176649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:54.549007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:54.567951 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2556798e-f873-4156-8b79-4a21d330969b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.426333 Sep 06 20:19:54.581652 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 277/581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:54 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:54.602449 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:54.603417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:54.617014 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:54.618522 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:54.618522 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:54.619385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:54.620397 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:54.621110 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:54.868442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:54.878677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8162441d-69bb-4070-8126-bddf67506947 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.282170 Sep 06 20:19:54.879285 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 305/582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:54 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:55.380721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:55.381569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:55.392729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.393650 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.394539 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.395625 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.396432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.397150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.444746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ee7d5f76-958f-4d1c-b620-5fe83f91dff8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71/ips" status: 200 len: 149 microversion: 2.1 time: 0.071345 Sep 06 20:19:55.445848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 278/583] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:19:55 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:19:55.459680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "570e399a-30ee-4003-9836-fe8530edc8c7"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:55.462440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:55.469827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.470323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.470766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.471569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.472067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.472499 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.477172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:55.607761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Invalid volume: volume 570e399a-30ee-4003-9836-fe8530edc8c7 is already attached to instances: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: POST /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71/os-volume_attachments HTTP/1.1 Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 74 Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:19:55.611251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {"volumeAttachment": {"volumeId": "570e399a-30ee-4003-9836-fe8530edc8c7"}} Sep 06 20:19:55.614200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Invalid volume: volume 570e399a-30ee-4003-9836-fe8530edc8c7 is already attached to instances: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'server_id': '475e333a-a670-43c9-b18b-251a960ede71', 'body': {'volumeAttachment': {'volumeId': '570e399a-30ee-4003-9836-fe8530edc8c7'}}} Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 570e399a-30ee-4003-9836-fe8530edc8c7 is already attached to instances: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:19:55.615825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 570e399a-30ee-4003-9836-fe8530edc8c7 is already attached to instances: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:19:55.618270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:19:55.621041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:19:55.621041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:19:55.621041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:19:55.621041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 570e399a-30ee-4003-9836-fe8530edc8c7 is already attached to instances: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 Sep 06 20:19:55.621041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:19:55.621041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 400 to user: Invalid volume: volume 570e399a-30ee-4003-9836-fe8530edc8c7 is already attached to instances: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:19:55.621041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d43e893e-04c8-4814-81f7-d9a053860d0b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.158645 Sep 06 20:19:55.622112 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1b3d5929-62ba-47c6-8eb9-7880c505ba88 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:19:55.622300 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 306/584] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:19:55 2022] POST /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 20:19:55.623691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:55.624495 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:55.626157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1b3d5929-62ba-47c6-8eb9-7880c505ba88 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.627078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1b3d5929-62ba-47c6-8eb9-7880c505ba88 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.627891 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1b3d5929-62ba-47c6-8eb9-7880c505ba88 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.636022 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.636801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.637533 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.637701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.638138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.638564 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.672436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1b3d5929-62ba-47c6-8eb9-7880c505ba88 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Going to try to stop instance {{(pid=120951) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 20:19:55.680449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:55.741044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1b3d5929-62ba-47c6-8eb9-7880c505ba88 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action" status: 202 len: 0 microversion: 2.1 time: 0.134106 Sep 06 20:19:55.741966 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 279/585] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:19:55 2022] POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:19:55.748247 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:55.749085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:55.758493 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.761640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.762096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.762860 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.763330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.763752 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.804075 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:19:55.879303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:55.889676 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3ce4e9ff-5a9e-475c-989f-55f06d9f2b3b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.272792 Sep 06 20:19:55.890242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 307/586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:55 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:55.895964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:55.896611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:55.904649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.905294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.906548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.909205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.909725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.910316 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.942429 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-92b08138-1937-41c2-9912-430edcde0023 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 204 len: 0 microversion: 2.1 time: 0.198764 Sep 06 20:19:55.943089 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 280/587] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:19:55 2022] DELETE /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:19:55.948830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:55.949520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:55.956972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.957456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.957925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:55.958640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:55.959069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:55.959484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:56.098250 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:56.106903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f52a3998-3121-4035-9fca-cd3d70552f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.214987 Sep 06 20:19:56.107610 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 308/588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:55 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:56.113776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:56.114675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:56.124292 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:56.125542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:56.126305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:56.127386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:56.128023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:56.128661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:56.131722 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:56.144981 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f7d54586-2a9c-4f81-be7f-2c885cc2c597 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.200536 Sep 06 20:19:56.145928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 281/589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:55 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:56.327353 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:56.336919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3e97efff-0231-4a65-9be9-12c5ba77aabf tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.228018 Sep 06 20:19:56.337502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 309/590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:56 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:56.923550 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:56.924511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:56.935139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:56.936321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:56.936569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:56.938229 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:56.938936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:56.939587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:57.111614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:57.120764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-96e265f7-9234-43b2-9180-de93b6b5af62 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.201738 Sep 06 20:19:57.121489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 282/591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:56 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:57.137513 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:57.138598 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:57.146194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:57.146631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:57.147070 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:57.147779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:57.148570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:57.148736 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:57.174216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:57.175108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:57.182489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:57.182997 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:57.183439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:57.184284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:57.184744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:57.185170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:57.337107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:57.345323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9681b130-93fa-4cd1-9034-fdd623e1b7e7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.212872 Sep 06 20:19:57.345945 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 310/592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:57 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:57.362526 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:57.374429 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f64ba64c-d0f7-45bf-89c1-058b09b08b5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.203714 Sep 06 20:19:57.375695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 283/593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:57 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:57.380265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:57.381431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:57.393362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:57.394298 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:57.395139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:57.396811 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:57.397223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:57.398035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:57.583178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:57.593430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f95db4e2-9f74-4978-a9b4-9079bebf02ad tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.220651 Sep 06 20:19:57.594701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 311/594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:57 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:58.145600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:58.146350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:58.154484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.155065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.155551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.156383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.157464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.157931 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.337427 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:58.346375 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e8ad1830-d38d-4e7d-ba1b-dc9fc98588e4 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.205598 Sep 06 20:19:58.346970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 284/595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:58 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:58.377703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:58.378327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:58.385098 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.385854 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.386373 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.387350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.387912 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.388391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.416679 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:58.417364 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:58.425396 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.426216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.426908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.428150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.428764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.429290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.580853 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:58.591773 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-40db0eb6-ad18-4e57-a48c-231cda22feb6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.219530 Sep 06 20:19:58.593006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 312/596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:58 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:19:58.623641 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:58.634938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:58.636662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:58.639930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f4629c9a-7dc1-4bd5-8251-0f4cbdddebe7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.228266 Sep 06 20:19:58.641337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 285/597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:58 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:58.645409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.646295 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.646995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.648031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:58.648540 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:58.648974 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:58.858760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:58.868009 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-053c26b8-c4fc-4d35-8fcb-94b459ec4da8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.240237 Sep 06 20:19:58.868605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 313/598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:58 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:59.371284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:59.372427 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:59.382762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.383623 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.384104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:59.384922 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.385478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.386055 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:59.554436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:59.564299 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-754379da-9a0b-4da6-8a02-8d0ec601ced9 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.197183 Sep 06 20:19:59.565128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 286/599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:59 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:59.632235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:59.633052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:59.639760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.640309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.640784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:59.641502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.641986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.642407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:59.680372 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:59.681094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:59.689430 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.690079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.690550 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:59.691469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.691937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.692482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:59.829408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:59.840228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1f274f97-5d31-4a07-b8fa-91b7b0009352 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.211909 Sep 06 20:19:59.841181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 314/600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:59 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:59.890230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:19:59.895669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:19:59.896545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:19:59.904706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2f32fd10-0547-4750-8857-d5cb9ea8e013 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.229198 Sep 06 20:19:59.905367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.905574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 287/601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:59 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:19:59.905961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.909725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:19:59.909725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:19:59.909725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:19:59.909725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:00.148461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:00.159178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-58f00c86-ecfa-41d0-ba6c-50a8159d39bb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.270684 Sep 06 20:20:00.159772 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 315/602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:19:59 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:00.590519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:00.591439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:00.599527 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:00.600020 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:00.600456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:00.601167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:00.601638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:00.602080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:00.767890 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:00.780499 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ee6f94da-d861-4ad2-ba70-2768014a5174 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.194445 Sep 06 20:20:00.781881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 288/603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:00 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:00.879583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:00.881672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:00.889767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:00.890401 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:00.890951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:00.891994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:00.892770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:00.893207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:00.936398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:00.938942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:00.951530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:00.952676 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:00.953882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:00.955588 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:00.956856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:00.957965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:01.192261 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:01.195063 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:01.205793 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-55c13307-69ae-489b-a097-db5a9b59caad tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.332036 Sep 06 20:20:01.213093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 316/604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:00 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:01.216946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-440c2320-c883-42af-8265-d62789a6fc0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.287209 Sep 06 20:20:01.218164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 289/605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:00 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:01.219366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-5dbcb8d1-0902-46b2-8ed4-c562ac2b8b80 req-b9a4f448-f257-42e8-be07-0a06e6cfdc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d46c6a-bba3-4e7e-ab96-f22796eee28e", "name": "network-vif-plugged", "status": "completed", "tag": "58da1786-9578-4fdc-816f-0dacca3e7184"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:01.226971 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=76 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:01.227815 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:01.228832 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:01.232693 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-5dbcb8d1-0902-46b2-8ed4-c562ac2b8b80 req-b9a4f448-f257-42e8-be07-0a06e6cfdc9a service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:01.233352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-5dbcb8d1-0902-46b2-8ed4-c562ac2b8b80 req-b9a4f448-f257-42e8-be07-0a06e6cfdc9a service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:01.233921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-5dbcb8d1-0902-46b2-8ed4-c562ac2b8b80 req-b9a4f448-f257-42e8-be07-0a06e6cfdc9a service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:01.241040 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:01.242006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:01.242767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:01.244227 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:01.244917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:01.245763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:01.247948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-5dbcb8d1-0902-46b2-8ed4-c562ac2b8b80 req-b9a4f448-f257-42e8-be07-0a06e6cfdc9a service nova] Creating event network-vif-plugged:58da1786-9578-4fdc-816f-0dacca3e7184 for instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e on hv-cinder-84773 Sep 06 20:20:01.253397 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-5dbcb8d1-0902-46b2-8ed4-c562ac2b8b80 req-b9a4f448-f257-42e8-be07-0a06e6cfdc9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038368 Sep 06 20:20:01.254083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 317/606] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:01.405692 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:01.414567 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d26d116c-d177-4a30-b1d9-9b4be80b97b4 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.194287 Sep 06 20:20:01.415153 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 290/607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:01 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:01.808800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:01.809514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:01.816562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:01.817067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:01.817506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:01.818286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:01.818750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:01.819175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:02.039424 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:02.049520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-13044cb5-5585-411a-b638-0a3df5cd0a33 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.244961 Sep 06 20:20:02.050193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 318/608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:01 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:02.235485 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:02.236595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:02.251548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:02.252323 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:02.253508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:02.255006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:02.256258 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:02.257142 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:02.261832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:02.263351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:02.273220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:02.273954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:02.274697 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:02.288178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:02.288178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:02.288178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:02.472807 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:02.481605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-519a9f7e-470c-4f05-af56-4b4ae0c7813a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.252799 Sep 06 20:20:02.482255 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 291/609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:02 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:02.488024 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:02.488644 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:02.495612 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:02.496107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:02.496760 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:02.497548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:02.498071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:02.498962 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:02.504127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:02.517935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-663df99f-c9ae-45c7-81a1-12908586ed0b tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.262905 Sep 06 20:20:02.518817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 319/610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:02 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:02.658916 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:02.667598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-26d32026-bffe-45e6-9184-1c87191bdb6a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.184208 Sep 06 20:20:02.668192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 292/611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:02 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:03.091766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:03.092848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:03.104536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.105411 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.106229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.107742 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.108773 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.109602 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.301348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:03.310748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-809422d0-4f01-404c-93e6-f568e6a9d223 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.225247 Sep 06 20:20:03.311362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 320/612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:03 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:03.517363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:03.518109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:03.525437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.525971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.526406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.527129 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.527586 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.528144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.545217 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:03.546071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:03.555592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.556632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.557208 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.558369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.559224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.560114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.718332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:03.725233 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:03.735284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a27eb0c3-9d3b-4f97-965b-de350e9f42bc tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.222053 Sep 06 20:20:03.735679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:03.736316 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 293/613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:03 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:03.744917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:03.746060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:03.747308 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-42cd80c3-1bd3-4443-9759-48cd12d600b9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.206372 Sep 06 20:20:03.751209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 321/614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:03 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:03.763676 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.764548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.765342 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.766845 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:03.767742 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:03.768635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:03.978774 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:03.996044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4e4f2c98-daa7-451d-85b9-51bd6f3ae0c6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.258275 Sep 06 20:20:03.996702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 294/615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:03 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:04.336584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:04.337299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:04.346561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:04.347313 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:04.348017 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:04.349125 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:04.349875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:04.350539 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:04.547253 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:04.556760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f7bec3ea-db43-4011-9346-e19bada37f76 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.224763 Sep 06 20:20:04.557898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 322/616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:04 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:04.762960 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:04.763715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:04.772251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:04.772980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:04.773547 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:04.774403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:04.774986 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:04.775514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:04.775881 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:04.776704 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:04.784982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:04.785512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:04.786051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:04.786730 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:04.787194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:04.787626 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:04.812185 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:04.972228 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:05.003972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ebbff059-bf87-481c-b523-ccb46f0feec8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.245286 Sep 06 20:20:05.010050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 295/617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:04 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:05.012398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:05.023506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:05.024124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:05.033326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bea34981-2be5-4917-acc5-8c832d39976a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.261832 Sep 06 20:20:05.034324 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 323/618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:04 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:05.039287 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:05.040069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:05.041004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:05.042177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:05.042836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:05.043487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:05.238356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:05.251370 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-99936382-7e5d-42f6-911c-ebd7fb804f72 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.232487 Sep 06 20:20:05.254640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 296/619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:05 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:05.589034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:05.590451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:05.601517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:05.602227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:05.602873 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:05.604216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:05.605430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:05.606167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:05.804004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:05.818873 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8eed9e22-e9c4-4cd6-acd4-37206611d56e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.237844 Sep 06 20:20:05.819677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 324/620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:05 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:06.032757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:06.033591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:06.043166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.043837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.044418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:06.046027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.046836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.047326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:06.293318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:06.305956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f7f96ebe-756b-4897-9a9f-f419650fcb53 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.279051 Sep 06 20:20:06.306638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 297/621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:06 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:06.311686 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:06.312088 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:06.312354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:06.312965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:06.319700 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.320185 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.320503 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.321138 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:06.321314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.321649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:06.322001 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.322350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.322522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.322884 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.323052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:06.323357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:06.499102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:06.510049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:06.515093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3f3080a7-f990-4f23-b136-8ca9da5d8ae5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.207071 Sep 06 20:20:06.516600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 298/622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:06 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:06.522995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-10b1f8d2-5469-4881-91bc-90e6472a133e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.465054 Sep 06 20:20:06.523761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 325/623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:06 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:06.859972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:06.860587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:06.867824 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.868411 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.868942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:06.869889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:06.870433 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:06.870919 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.061302 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:07.070514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-853e8073-16c4-495d-a14f-fb5276dc586b tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.214664 Sep 06 20:20:07.071170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 299/624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:06 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:07.352205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:07.354544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:07.380436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:07.391698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:07.393070 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.395150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:07.396290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:07.400987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.519559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-55e32415-f783-46ec-b11a-d58701de785b req-1c5148c7-c499-4a0a-b24e-6d6d0f1d46f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475e333a-a670-43c9-b18b-251a960ede71", "name": "network-vif-unplugged", "status": "completed", "tag": "7e6adc77-9fc4-4658-9d15-0c9d656d3797"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:07.555215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-55e32415-f783-46ec-b11a-d58701de785b req-1c5148c7-c499-4a0a-b24e-6d6d0f1d46f1 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:07.565257 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-55e32415-f783-46ec-b11a-d58701de785b req-1c5148c7-c499-4a0a-b24e-6d6d0f1d46f1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:07.567108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-55e32415-f783-46ec-b11a-d58701de785b req-1c5148c7-c499-4a0a-b24e-6d6d0f1d46f1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.598664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-55e32415-f783-46ec-b11a-d58701de785b req-1c5148c7-c499-4a0a-b24e-6d6d0f1d46f1 service nova] Creating event network-vif-unplugged:7e6adc77-9fc4-4658-9d15-0c9d656d3797 for instance 475e333a-a670-43c9-b18b-251a960ede71 on hv-cinder-84773 Sep 06 20:20:07.617300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-55e32415-f783-46ec-b11a-d58701de785b req-1c5148c7-c499-4a0a-b24e-6d6d0f1d46f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106928 Sep 06 20:20:07.622425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 300/625] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:20:07.629446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:07.630363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:07.641571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:07.644684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:07.646379 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.647587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:07.648460 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:07.649468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.742006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:07.759113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-02e325fd-a43b-450a-b864-9dd21d6510e2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.415510 Sep 06 20:20:07.760159 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 326/626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:07 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:07.770361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:07.771850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:07.786770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:07.787511 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:07.788060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.789005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:07.789530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:07.790120 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:07.991996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:08.006106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bf88c526-3914-43e1-b22b-37da47c5004d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1680 microversion: 2.1 time: 0.381649 Sep 06 20:20:08.014398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 301/627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:07 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1680 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:08.025502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:08.038669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-60cd97c4-8cb4-4e63-bd3d-b6faf3dbe667 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.276539 Sep 06 20:20:08.039640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 327/628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:07 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:08.101523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:08.102842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:08.115509 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:08.116406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:08.117223 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:08.118580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:08.119450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:08.120255 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:08.422622 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:08.434151 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0f13da85-8ce3-447d-9d4e-32f6ab78ecb6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1258 microversion: 2.1 time: 0.340426 Sep 06 20:20:08.434942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 302/629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:08 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1258 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:08.715676 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-a072e643-2e56-4be7-97b4-f315599322d3 req-8cdb7a49-c41a-4837-aead-60ce1838951c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "475e333a-a670-43c9-b18b-251a960ede71", "name": "network-vif-deleted", "tag": "7e6adc77-9fc4-4658-9d15-0c9d656d3797"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:08.730497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-a072e643-2e56-4be7-97b4-f315599322d3 req-8cdb7a49-c41a-4837-aead-60ce1838951c service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:08.731317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-a072e643-2e56-4be7-97b4-f315599322d3 req-8cdb7a49-c41a-4837-aead-60ce1838951c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:08.731958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-a072e643-2e56-4be7-97b4-f315599322d3 req-8cdb7a49-c41a-4837-aead-60ce1838951c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:08.748527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-a072e643-2e56-4be7-97b4-f315599322d3 req-8cdb7a49-c41a-4837-aead-60ce1838951c service nova] Creating event network-vif-deleted:7e6adc77-9fc4-4658-9d15-0c9d656d3797 for instance 475e333a-a670-43c9-b18b-251a960ede71 on hv-cinder-84773 Sep 06 20:20:08.758191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-a072e643-2e56-4be7-97b4-f315599322d3 req-8cdb7a49-c41a-4837-aead-60ce1838951c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046705 Sep 06 20:20:08.759144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 328/630] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:20:08.792658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:08.793369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:08.801835 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:08.802470 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:08.802755 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:08.803676 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:08.804579 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:08.805077 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.045270 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:09.053960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:09.055593 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:09.066408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ddf42a1c-55cf-4013-82e3-ee45d4faaf85 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.277862 Sep 06 20:20:09.067319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.068200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.069247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.070922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.071608 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 303/631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:08 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:09.072793 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.073785 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.082508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:09.083742 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:09.096104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.096574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.097059 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.097826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.098525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.098945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.424468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:09.442103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3b1ff3e5-8da5-4285-a293-d0070220e483 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.368421 Sep 06 20:20:09.443180 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 304/632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:09 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:09.467212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:09.468840 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:09.502470 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.503325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.504000 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.504964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.505673 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.506417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.518627 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:09.547851 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2f53de7d-793a-4186-994d-9a0e63057272 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1325 microversion: 2.1 time: 0.504085 Sep 06 20:20:09.549793 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 329/633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:09 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:09.735831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:09.745524 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a362c1ab-57f1-4982-add1-da4e9a380e12 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1442 microversion: 2.1 time: 0.285516 Sep 06 20:20:09.764793 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 305/634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:09 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1442 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:09.779727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:09.782653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:09.797512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.799037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.800328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:09.802762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:09.804163 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:09.805354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.096339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:10.097230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:10.111939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:10.117807 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:10.118383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:10.122032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2eb83462-66c1-4421-9e64-7386a812edd7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1442 microversion: 2.1 time: 0.352316 Sep 06 20:20:10.123800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 330/635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:09 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1442 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:10.126681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.128469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:10.128963 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:10.129400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.470790 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:10.472160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:10.481852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:10.486405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:10.487657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.488816 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:10.489443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:10.508705 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3bff9928-76bf-4ae3-93e1-9056ae2d2332 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.416518 Sep 06 20:20:10.509373 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:10.510072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.516501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 306/636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:10 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:10.604870 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:10.606507 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:10.623163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:10.627594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:10.628577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.635578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:10.641671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:10.642735 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.753761 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:10.758489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:10.759383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:10.760277 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'fault' on Instance uuid 475e333a-a670-43c9-b18b-251a960ede71 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:10.827604 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:10.882461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c0f43aed-c21f-44f1-ae1c-ccb244eefeb4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.415010 Sep 06 20:20:10.886314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 331/637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:10 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:10.969537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:10.988118 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2c075515-e0fc-4420-82f7-d1e29bbd1dcd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 200 len: 1330 microversion: 2.1 time: 0.400715 Sep 06 20:20:10.991801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 307/638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:10 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 1330 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:11.546492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:11.548128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:11.557310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:11.557865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:11.558580 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:11.559911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:11.561709 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:11.564329 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:11.844766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:11.864833 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f9e4fada-b58d-4d72-9982-9888e51d0f69 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.323842 Sep 06 20:20:11.866527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 332/639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:11 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:11.938270 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:11.940499 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:11.955045 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:11.956361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:11.957897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:11.960099 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:11.961696 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:11.962662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:12.053919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:12.054956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:12.073239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:12.074098 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:12.074846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:12.076093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:12.076917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:12.078054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:12.128219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 HTTP/1.1 Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:20:12.135245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:20:12.137765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '475e333a-a670-43c9-b18b-251a960ede71'} Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:20:12.138996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:20:12.140605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:12.142138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:20:12.142138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-dbb1d5cd-e994-4830-a80f-0f253ae82337 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 404 len: 111 microversion: 2.1 time: 0.099677 Sep 06 20:20:12.145788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 333/640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:12 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:20:12.158456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8a54bc22-5f81-419a-b809-c629231587b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '.version_select at 0x7f9c37b630d0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:12.202569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8a54bc22-5f81-419a-b809-c629231587b8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-167102266" status: 202 len: 0 microversion: 2.1 time: 0.054478 Sep 06 20:20:12.209439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 334/641] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 20:20:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-167102266 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:20:12.385733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:12.388161 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:12.409196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:12.410635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:12.411812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:12.415976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:12.417585 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:12.418802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:12.520130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:12.561837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ca648561-93bc-4977-ba9d-8fc9f9a6463a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.631135 Sep 06 20:20:12.570720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 308/642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:11 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:12.706099 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lazy-loading 'services' on Instance uuid 84150d05-acce-4f9a-87cd-5ec3ce987386 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:12.882186 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-51e5bc76-09b6-44d4-8161-6875ff7e2fe5 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386/os-volume_attachments/f5f530e4-c0ed-4c9e-bb2c-557822620e31" status: 202 len: 0 microversion: 2.1 time: 0.509689 Sep 06 20:20:12.883248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 335/643] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:20:12 2022] DELETE /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386/os-volume_attachments/f5f530e4-c0ed-4c9e-bb2c-557822620e31 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:20:12.915174 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:12.916349 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:12.944384 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:12.945249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:12.961948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:12.963469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:12.964335 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:12.965202 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:13.463906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:13.477846 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0e2ea32d-90b6-4492-ac4e-2ed9f6bf35b0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.573148 Sep 06 20:20:13.478717 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 309/644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:12 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:13.586847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:13.587678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:13.596010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:13.596612 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:13.597050 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:13.598114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:13.598582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:13.599348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:13.605268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:13.606787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:13.619079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:13.619860 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:13.621044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:13.623145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:13.624791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:13.626442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:13.692837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 20:20:13.693097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Tue Sep 6 20:20:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments/570e399a-30ee-4003-9836-fe8530edc8c7 (ip 10.222.0.20) !!! Sep 06 20:20:13.778012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'services' on Instance uuid 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:13.893148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1cc5c5b3-9b26-4ef0-9bfb-dcc0f0bb5e28 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments/570e399a-30ee-4003-9836-fe8530edc8c7" status: 202 len: 0 microversion: 2.1 time: 0.311440 Sep 06 20:20:13.898465 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 336/645] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:20:13 2022] DELETE /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments/570e399a-30ee-4003-9836-fe8530edc8c7 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:20:13.905351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:13.908598 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:13.920292 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:13.921032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:13.921631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:13.923350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:13.924077 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:13.924724 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:13.978901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d34637bb-aa0b-4389-8110-281308404251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078859 Sep 06 20:20:13.979820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 337/646] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:20:13 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:13.998321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:14.010842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:14.024541 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0c29ac93-d00f-4c14-99db-ae7a24ce0b01 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.425723 Sep 06 20:20:14.026413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 310/647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:13 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:14.882242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:14.883037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:14.899825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:14.900821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:14.902831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:14.905021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:14.907561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:14.909538 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:14.964846 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-268fae7e-defd-462f-bb52-a802b94921be req-ea7c0b47-d563-4c91-8e62-027de9767e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d46c6a-bba3-4e7e-ab96-f22796eee28e", "tag": "58da1786-9578-4fdc-816f-0dacca3e7184"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:14.990778 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-268fae7e-defd-462f-bb52-a802b94921be req-ea7c0b47-d563-4c91-8e62-027de9767e82 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:14.992052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-268fae7e-defd-462f-bb52-a802b94921be req-ea7c0b47-d563-4c91-8e62-027de9767e82 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:14.993748 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-268fae7e-defd-462f-bb52-a802b94921be req-ea7c0b47-d563-4c91-8e62-027de9767e82 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:15.042716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-268fae7e-defd-462f-bb52-a802b94921be req-ea7c0b47-d563-4c91-8e62-027de9767e82 service nova] Creating event network-changed:58da1786-9578-4fdc-816f-0dacca3e7184 for instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e on hv-cinder-84773 Sep 06 20:20:15.054483 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-268fae7e-defd-462f-bb52-a802b94921be req-ea7c0b47-d563-4c91-8e62-027de9767e82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098111 Sep 06 20:20:15.056350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 311/648] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:20:15.068475 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:15.073651 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:15.088089 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:15.090046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:15.091967 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:15.093600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:15.095391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:15.096443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:15.166020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:15.175970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-24815c07-b064-41ca-8274-f1b503adb2a9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.672488 Sep 06 20:20:15.177310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 338/649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:14 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:15.182821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:15.183761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:15.192770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:15.193762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:15.194449 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:15.195470 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:15.196152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:15.196821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:15.202334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-61f347ab-3665-4a24-8bba-9291dea52125 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143186 Sep 06 20:20:15.203247 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 312/650] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:20:15 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:15.528144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:15.550407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c64378ab-7875-47d3-8e34-f712d76132d3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.371601 Sep 06 20:20:15.551175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 339/651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:15 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:16.220968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:16.227802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:16.228604 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:16.234144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:16.242607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:16.243488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:16.244148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:16.245196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:16.245476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:16.246219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:16.247009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:16.247318 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:16.247915 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:16.248917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:16.249456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:16.250073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:16.308598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-220cfeb5-e8e4-4bef-823b-eb8e1d4317d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094070 Sep 06 20:20:16.313839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 313/652] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:20:16 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:16.589000 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:16.589642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:16.601121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:16.601870 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:16.602757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:16.604045 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:16.604529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:16.605165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:16.619390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:16.637117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4ec80a31-8d6b-446f-86f7-e476c61f01be tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1678 microversion: 2.1 time: 0.412988 Sep 06 20:20:16.646206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 340/653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:16 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1678 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:17.326747 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:17.331949 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:17.344588 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.346106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.346919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:17.348651 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.349669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.350765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:17.357668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:17.419556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f0e8c3a6-8440-438d-a820-a7151a4fd6e3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099880 Sep 06 20:20:17.426780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 341/654] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:20:17 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:20:17.483357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:17.492514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:17.494127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:17.503017 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2ee7f2a5-115a-4369-a003-beed615e547d tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1735 microversion: 2.1 time: 0.918282 Sep 06 20:20:17.503615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 314/655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:16 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1735 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:17.506086 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.507263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.508147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:17.509516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.510611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.511625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:17.569209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:20:17.675718 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:17.676870 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:17.692884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.693392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.695979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:17.696822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.697301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.701341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:17.780989 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0f873d6f-6fdf-4671-8469-062a671bbe48 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 204 len: 0 microversion: 2.1 time: 0.296322 Sep 06 20:20:17.786579 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 342/656] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:20:17 2022] DELETE /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:20:17.798555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:17.799407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:17.808934 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.809767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.810507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:17.811749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:17.812537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:17.813242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.044397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:18.065545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-18f91404-b837-405a-8835-efca4a037867 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1655 microversion: 2.1 time: 0.397748 Sep 06 20:20:18.066703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 315/657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:17 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1655 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:18.120078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ce8e0e59-b3de-4ccc-a04e-12762e1a9158 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:18.147767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce8e0e59-b3de-4ccc-a04e-12762e1a9158 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:18.148669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce8e0e59-b3de-4ccc-a04e-12762e1a9158 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:18.149494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ce8e0e59-b3de-4ccc-a04e-12762e1a9158 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.201539 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ce8e0e59-b3de-4ccc-a04e-12762e1a9158 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Going to try to start instance {{(pid=120951) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 20:20:18.395695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ce8e0e59-b3de-4ccc-a04e-12762e1a9158 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action" status: 202 len: 0 microversion: 2.1 time: 0.282073 Sep 06 20:20:18.397118 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 316/658] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:20:18 2022] POST /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:20:18.414073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:18.415986 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:18.428067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:18.429366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:18.430402 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.432006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:18.433284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:18.434377 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.533523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:18.576424 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-89030e17-bd62-4079-a7ae-2553067a2ca9 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1514 microversion: 2.1 time: 0.787742 Sep 06 20:20:18.577400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 343/659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:17 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1514 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:18.592829 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:18.597067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:18.605256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:18.605789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:18.606227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.606949 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:18.607421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:18.608054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.652903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-569148ff-74d0-444f-9815-4f31a55ae457 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073616 Sep 06 20:20:18.653964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 344/660] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:20:18 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:18.660110 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:18.661074 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:18.667659 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:18.668163 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:18.668617 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.669375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:18.669890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:18.670323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:18.839419 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:18.851076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-eac585ed-55e7-4eba-8747-d8891accf0dd tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1715 microversion: 2.1 time: 0.195925 Sep 06 20:20:18.851678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 345/661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:18 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1715 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:18.882968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:18.906071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-47b6fb29-3973-47de-9663-74fe86e26ea3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1664 microversion: 2.1 time: 0.501302 Sep 06 20:20:18.907992 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 317/662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:18 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1664 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:19.063778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:19.064382 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:19.072837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.073516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.074092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.074914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.075619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.076311 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.232349 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] HTTP exception thrown: Cannot 'detach_volume' instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 while it is in vm_state rescued Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Request method failure captured: Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: DELETE /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments/4b616e49-5605-411c-b77c-6b8dd7b4203c HTTP/1.1 Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pIzR1wGZoVZFCzLwuJtb60ZoHuW7x7VIRJBdTIgSLkhJ6MogAG81kphlJRWd2yzkQSH5VGRjxyve3vfCIJtUG5nSEMdNyhbgU5EgzTp213wFCnb7n7X7K58tvVQdM_JVlj8ckacBhgXuyLEUcNV8FfhX939pH7jINLvbt8aXN1D2o Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:20:19.236202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b005ff023a9f46fda3ceef605996c385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ecde3e4bfd8b4f3490edd3832cea9e48 Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:20:19.238844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Cannot 'detach_volume' instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 while it is in vm_state rescued Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'server_id': '6bb7e4a2-f24c-4129-8d88-30e71c6d9f73', 'id': '4b616e49-5605-411c-b77c-6b8dd7b4203c'} Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:20:19.240103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 while it is in vm_state rescued Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 while it is in vm_state rescued Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:19.243958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Returning 409 to user: Cannot 'detach_volume' instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 while it is in vm_state rescued {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:20:19.247436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-586d0c16-b8ed-44f5-b774-c3fbfa9df34c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments/4b616e49-5605-411c-b77c-6b8dd7b4203c" status: 409 len: 152 microversion: 2.1 time: 0.180871 Sep 06 20:20:19.247436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 346/663] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:20:19 2022] DELETE /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments/4b616e49-5605-411c-b77c-6b8dd7b4203c => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 20:20:19.253199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:19.254016 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:19.256558 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:19.265366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.266612 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.267252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.268047 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.268808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.269254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.362120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f1dcdeb6-9f9b-49a8-b95e-0575ae2b93b8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "POST /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/action" status: 202 len: 0 microversion: 2.1 time: 0.114273 Sep 06 20:20:19.366216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 318/664] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:20:19 2022] POST /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:20:19.372504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:19.373481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:19.384894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.385507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.386223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.386983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.387464 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.387901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.592699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:19.604819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-43ad06dd-9049-4e79-99cb-82ca08abb91c tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.235467 Sep 06 20:20:19.620083 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:19.621065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:19.624714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 347/665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:19 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:19.633178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.633590 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.634107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.634822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.635290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.635727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.674611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:19.679683 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:19.705207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.706297 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.706767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.707536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.708011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.708449 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.763037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b74d393f-f254-41ff-962a-597ea7ab22d6 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095159 Sep 06 20:20:19.764377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 348/666] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:20:19 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:19.950131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:19.959577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:19.962511 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:19.962823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-32a02de4-5b08-4dab-b234-ef63dca5b93f tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1514 microversion: 2.1 time: 0.355687 Sep 06 20:20:19.963241 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 319/667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:19 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:19.984245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.985745 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.987770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:19.988894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:19.989580 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:19.990623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:20.379128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:20.392983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-53acc939-0ad6-4a94-96e3-91c207440fc5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1664 microversion: 2.1 time: 0.457170 Sep 06 20:20:20.394000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 349/668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:19 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1664 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:20.628554 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:20.629969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:20.649891 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:20.651808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:20.653521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:20.656042 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:20.656820 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:20.662656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:20.782013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:20.784753 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:20.799236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:20.799741 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:20.800169 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:20.800900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:20.801356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:20.801816 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:20.850327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-96dd3b99-38a5-402f-895f-01b6c84b25cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072928 Sep 06 20:20:20.850919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 350/669] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:20:20 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 20:20:20.996964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:20.997665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:21.009913 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.011399 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.012422 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.013687 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.014638 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.015682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.061931 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:20:21.210575 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-86a3682a-113a-4715-a4a1-6d79d9ffdd99 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 204 len: 0 microversion: 2.1 time: 0.220298 Sep 06 20:20:21.217867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 351/670] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:20:20 2022] DELETE /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 20:20:21.224943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:21.227774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:21.239237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.240091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.240867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.242223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.243249 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.244066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.300492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:21.314155 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-aa39fbaf-6b01-4f51-8f0c-14380f0497d1 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.690012 Sep 06 20:20:21.315537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 320/671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:20 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:21.361156 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:21.362711 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:21.377049 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.378408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.379509 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.381400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.382583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.383586 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.519331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:21.532224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-60c970dc-f2c0-4a9c-b587-f17570bf608a tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1514 microversion: 2.1 time: 0.317419 Sep 06 20:20:21.533739 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 352/672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:21 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:21.541078 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:21.541802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:21.554448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.554814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.555441 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.557022 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:21.557764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:21.559387 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:21.865543 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:21.892025 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-58d31f90-3895-49a9-a3e0-59e47b0f5489 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1664 microversion: 2.1 time: 0.356800 Sep 06 20:20:21.893089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 353/673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:21 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1664 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:21.971890 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:21.988158 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7cd2612e-a9b3-46c2-8fbd-4174628d74eb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1683 microversion: 2.1 time: 0.654722 Sep 06 20:20:21.990307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 321/674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:21 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1683 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:22.365341 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:22.366380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:22.374210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:22.374798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:22.375902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:22.376879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:22.377858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:22.378574 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:22.391365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-83d9a2b2-f7ee-4f43-91a4-1c7a2cd381f0 req-dd3a2fce-572b-4bce-8f9c-57137ad6d3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84150d05-acce-4f9a-87cd-5ec3ce987386", "name": "network-vif-deleted", "tag": "eb12f874-144e-4f2d-9e2b-20c1290bd4f5"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:22.413972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-83d9a2b2-f7ee-4f43-91a4-1c7a2cd381f0 req-dd3a2fce-572b-4bce-8f9c-57137ad6d3a6 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:22.414552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-83d9a2b2-f7ee-4f43-91a4-1c7a2cd381f0 req-dd3a2fce-572b-4bce-8f9c-57137ad6d3a6 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:22.415287 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-83d9a2b2-f7ee-4f43-91a4-1c7a2cd381f0 req-dd3a2fce-572b-4bce-8f9c-57137ad6d3a6 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:22.424931 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:22.449715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-83d9a2b2-f7ee-4f43-91a4-1c7a2cd381f0 req-dd3a2fce-572b-4bce-8f9c-57137ad6d3a6 service nova] Creating event network-vif-deleted:eb12f874-144e-4f2d-9e2b-20c1290bd4f5 for instance 84150d05-acce-4f9a-87cd-5ec3ce987386 on hv-cinder-84773 Sep 06 20:20:22.456696 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-83d9a2b2-f7ee-4f43-91a4-1c7a2cd381f0 req-dd3a2fce-572b-4bce-8f9c-57137ad6d3a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069003 Sep 06 20:20:22.457658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 322/675] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:20:22.576386 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:22.577097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:22.584470 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:22.584954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:22.585787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:22.586867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:22.587634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:22.588470 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:22.649195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:22.663035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-35bb0e7f-7c60-440b-bb5c-ec087ccd79c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.303121 Sep 06 20:20:22.663994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 354/676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:22 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:22.690139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:22.710894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e509124f-abe0-4322-b415-04993dd7943b tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1472 microversion: 2.1 time: 0.138507 Sep 06 20:20:22.713382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 323/677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:22 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1472 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:22.933562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:22.935005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:22.948272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:22.948821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:22.949272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:22.950066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:22.950546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:22.950993 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:23.044041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:23.052898 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:23.082278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:23.083320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:23.084044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:23.086865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:23.090928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:23.092642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:23.275185 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:23.294804 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b2409625-4499-45c0-9c07-78997d0e2915 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1664 microversion: 2.1 time: 0.365375 Sep 06 20:20:23.310331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 355/678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:22 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1664 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:23.725469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:23.734384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:23.755824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:23.758785 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:23.759902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:23.761365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:23.762377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:23.763229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:24.034991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:24.051075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9f9a796f-dec4-4c96-a046-607787c97105 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.337168 Sep 06 20:20:24.052061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 356/679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:23 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:24.077559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:24.078758 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:24.089919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:24.090508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:24.090973 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:24.091699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:24.092385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:24.092914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:24.135711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:24.136877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:24.137808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:24.138719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lazy-loading 'fault' on Instance uuid 84150d05-acce-4f9a-87cd-5ec3ce987386 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:24.170096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:24.238663 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8b11430a-9fab-424f-8888-477610828e38 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1683 microversion: 2.1 time: 1.203272 Sep 06 20:20:24.248022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 324/680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:23 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1683 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:24.328946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:24.335394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:24.350567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8cc79586f4cb79c962ede8342f580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5de971d8037434fbaf3c5aa93729028', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:24.358749 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:24.360789 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:24.361898 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:24.363439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:24.364716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:24.366146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:24.372210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-51bc90ec-0113-465d-8c36-481e7baa1166 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 200 len: 1309 microversion: 2.1 time: 0.318679 Sep 06 20:20:24.394982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 357/681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:24 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:24.436941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-67b67b50-5ab4-419e-b1b0-eb986f6fc158 req-e7e74529-6706-46de-915e-29141069308d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a69dcaa-e0c4-49b1-a7c4-74e4a5219936", "name": "network-vif-unplugged", "status": "completed", "tag": "f366b771-f138-4234-b315-fb86387e043d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:24.455597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-67b67b50-5ab4-419e-b1b0-eb986f6fc158 req-e7e74529-6706-46de-915e-29141069308d service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:24.456167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-67b67b50-5ab4-419e-b1b0-eb986f6fc158 req-e7e74529-6706-46de-915e-29141069308d service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:24.456603 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-67b67b50-5ab4-419e-b1b0-eb986f6fc158 req-e7e74529-6706-46de-915e-29141069308d service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:24.496509 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-67b67b50-5ab4-419e-b1b0-eb986f6fc158 req-e7e74529-6706-46de-915e-29141069308d service nova] Creating event network-vif-unplugged:f366b771-f138-4234-b315-fb86387e043d for instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 on hv-cinder-84773 Sep 06 20:20:24.509431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-67b67b50-5ab4-419e-b1b0-eb986f6fc158 req-e7e74529-6706-46de-915e-29141069308d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074992 Sep 06 20:20:24.511504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 358/682] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:25.084124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:25.084942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:25.087494 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:25.094386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:25.095067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:25.095886 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:25.096559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:25.097028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:25.097796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:25.253228 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:25.262040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:25.263622 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-61b59e68-165e-4977-844a-f419d27968f5 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1664 microversion: 2.1 time: 0.945596 Sep 06 20:20:25.264334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 325/683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:24 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1664 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:25.272992 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:25.274395 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:25.284241 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:25.285128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:25.285985 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:25.287780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-936afd8d-8ed1-4f5c-a30c-d34f7b94b741 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.209215 Sep 06 20:20:25.288525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:25.289159 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:25.289867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 359/684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:25 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:25.290583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:25.409715 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:25.410340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] [instance: 84150d05-acce-4f9a-87cd-5ec3ce987386] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:25.417665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:25.418338 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:25.418788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:25.419526 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:25.421043 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:25.421043 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:25.439802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] HTTP exception thrown: Instance 84150d05-acce-4f9a-87cd-5ec3ce987386 could not be found. Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Request method failure captured: Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 HTTP/1.1 Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6q3jtWZl3OtKA5VodomCyo1q98cHTZLDr-9Ip_IIiWfvdKIsvq_I6LQonD-lRc4kv06h-r1JkPoFz138p7qKWH1IMUZPVvreuhjJfidBHH4pIUVdKwqJDRh4N8UL4Dk-8PQthAmQz_RTVD3pPQWTWIe8-7T0Q50OP9iTtvM7w8A_Vg Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: b5de971d8037434fbaf3c5aa93729028 Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesSnapshotTestJSON-514333503 Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:20:25.440889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5de971d8037434fbaf3c5aa93729028"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesSnapshotTestJSON-514333503 Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: b5de971d8037434fbaf3c5aa93729028 Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-514333503 Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesSnapshotTestJSON-514333503-project Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 87f8cc79586f4cb79c962ede8342f580 Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesSnapshotTestJSON-514333503-project Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 84150d05-acce-4f9a-87cd-5ec3ce987386 could not be found. Sep 06 20:20:25.443552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '84150d05-acce-4f9a-87cd-5ec3ce987386'} Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84150d05-acce-4f9a-87cd-5ec3ce987386 could not be found. Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:20:25.446944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84150d05-acce-4f9a-87cd-5ec3ce987386 could not be found. Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84150d05-acce-4f9a-87cd-5ec3ce987386 could not be found. Sep 06 20:20:25.449506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:25.453766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] Returning 404 to user: Instance 84150d05-acce-4f9a-87cd-5ec3ce987386 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:20:25.453766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c41b9893-7d29-4359-b18a-422fc877bd51 tempest-VolumesSnapshotTestJSON-514333503 tempest-VolumesSnapshotTestJSON-514333503-project] 10.222.0.20 "GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386" status: 404 len: 111 microversion: 2.1 time: 0.037726 Sep 06 20:20:25.456942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 360/685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:25 2022] GET /compute/v2.1/servers/84150d05-acce-4f9a-87cd-5ec3ce987386 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:20:25.883862 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:25.894049 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:25.908458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1986f7a0-691a-470d-9220-41522f82cdd1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1683 microversion: 2.1 time: 0.638622 Sep 06 20:20:25.923279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 326/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:25 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1683 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:26.295020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:26.295951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:26.307720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:26.308386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:26.309080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:26.310835 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:26.311402 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:26.311909 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:26.319605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:26.320501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:26.333670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:26.338656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:26.339698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:26.341159 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:26.342122 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:26.343354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:26.549577 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:26.566848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3426a320-211e-45a3-a909-db67936824dd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1668 microversion: 2.1 time: 0.275324 Sep 06 20:20:26.576065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 361/687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:26 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1668 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:26.784315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:26.795405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d9065342-03ba-4eed-831c-70988e38391f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.480925 Sep 06 20:20:26.795972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 327/688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:26 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:26.961122 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:26.962026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:26.973222 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:26.974270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:26.975368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:26.977233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:26.978486 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:26.980665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:27.117056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:27.139155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-daacbbcd-209f-4614-bed6-d760982e92c2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1615 microversion: 2.1 time: 0.183233 Sep 06 20:20:27.144241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 362/689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:26 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1615 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:27.346050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-af992d01-9bfb-4f10-aa6b-e0ff94b2a037 req-6b63df02-0123-4402-af55-e939b8037012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a69dcaa-e0c4-49b1-a7c4-74e4a5219936", "name": "network-vif-deleted", "tag": "f366b771-f138-4234-b315-fb86387e043d"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:27.408348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-af992d01-9bfb-4f10-aa6b-e0ff94b2a037 req-6b63df02-0123-4402-af55-e939b8037012 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:27.412348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-af992d01-9bfb-4f10-aa6b-e0ff94b2a037 req-6b63df02-0123-4402-af55-e939b8037012 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:27.417467 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-af992d01-9bfb-4f10-aa6b-e0ff94b2a037 req-6b63df02-0123-4402-af55-e939b8037012 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:27.455128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-af992d01-9bfb-4f10-aa6b-e0ff94b2a037 req-6b63df02-0123-4402-af55-e939b8037012 service nova] Creating event network-vif-deleted:f366b771-f138-4234-b315-fb86387e043d for instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 on hv-cinder-84773 Sep 06 20:20:27.473447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-af992d01-9bfb-4f10-aa6b-e0ff94b2a037 req-6b63df02-0123-4402-af55-e939b8037012 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133163 Sep 06 20:20:27.474906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 328/690] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:27.824410 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:27.825212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:27.847172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:27.847546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:27.848001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:27.848806 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:27.849247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:27.856431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:28.132612 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:28.145558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-266cc9f0-97b1-4509-b9b1-e588bc75525f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.326626 Sep 06 20:20:28.146875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 363/691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:27 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:28.191733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:28.193037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:28.204551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:28.205346 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:28.206029 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:28.207163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:28.210553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:28.211582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:28.283589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:28.283964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:28.284921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:28.285982 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'fault' on Instance uuid 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:28.705754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:28.716354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1a3b15d3-0d21-445b-8d75-ef908e7fb65a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1332 microversion: 2.1 time: 0.531609 Sep 06 20:20:28.730216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 329/692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:28 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1332 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:29.204926 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:29.207443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:29.218283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:29.222766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:29.223517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:29.224600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:29.225391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:29.226104 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:29.482547 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:29.521593 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a2fc24dd-7115-42c5-bd6c-97f3ae98c9ef tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.334584 Sep 06 20:20:29.522857 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 364/693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:29 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:29.743721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:29.744752 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:29.751999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:29.752667 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:29.753303 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:29.754296 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:29.754964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:29.755592 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:29.800187 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:29.801298 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:29.802087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:29.802798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'fault' on Instance uuid 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:29.877375 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:29.887211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c6eed89a-907c-4e17-9154-6a45097a9656 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1332 microversion: 2.1 time: 0.147683 Sep 06 20:20:29.904665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 330/694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:29 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1332 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:30.553292 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:30.554126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:30.579018 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:30.579805 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:30.580454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:30.581510 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:30.582210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:30.582801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:30.918359 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:30.941150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d2dbba72-4b02-40c2-957c-1c4bbf70615f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1723 microversion: 2.1 time: 0.394768 Sep 06 20:20:30.943125 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 365/695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:30 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:30.944826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:30.950116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:30.980977 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:30.982315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:30.985647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:30.987742 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:30.988896 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:30.989881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:31.090136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:31.090994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:31.091634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:31.092262 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'fault' on Instance uuid 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:31.183980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:31.224595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-10c7cf7a-b4d4-4e32-b767-dea3e5eb41bc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1332 microversion: 2.1 time: 0.290428 Sep 06 20:20:31.244132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 331/696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:30 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1332 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:31.989516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:31.992527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:32.015065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:32.017807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:32.018720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:32.020425 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:32.021350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:32.022415 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:32.273878 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:32.278707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:32.321291 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:32.325362 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:32.335448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:32.336721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:32.337598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:32.343078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:32.458230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:32.467147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:32.471872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:32.474495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'fault' on Instance uuid 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:32.600336 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:32.627194 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-abc207f0-1bac-42f2-9df5-1671f40c86fb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 200 len: 1332 microversion: 2.1 time: 0.364759 Sep 06 20:20:32.629128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 332/697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:32 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 1332 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:32.685431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:32.704934 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-24819111-fd43-48f4-825e-77a2530a4ac4 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1729 microversion: 2.1 time: 0.723304 Sep 06 20:20:32.712601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 366/698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:31 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1729 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:32.742530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:32.753373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:32.774367 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:32.775407 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:32.776758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:32.778455 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:32.785295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:32.786501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:32.962993 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9c6ee33d-ec5e-4399-ae4c-8e03d526c591 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229688 Sep 06 20:20:32.964186 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 333/699] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:20:32 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:33.680976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:33.703530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:33.742734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:33.746317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:33.751786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:33.753446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:33.754425 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:33.755374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:33.835366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 HTTP/1.1 Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:20:33.839155 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:20:33.842247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '1a69dcaa-e0c4-49b1-a7c4-74e4a5219936'} Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:20:33.844038 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:20:33.847056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:33.852755 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:20:33.852755 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-97f5bc0f-e1bb-4621-9429-14ce02dc9d4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 404 len: 111 microversion: 2.1 time: 0.173584 Sep 06 20:20:33.852755 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 367/700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:33 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:20:33.859645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b9a8463b-a87d-48e1-ac98-be4cd5cf6e40 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '.version_select at 0x7f9c3b8d1820>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:33.896828 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b9a8463b-a87d-48e1-ac98-be4cd5cf6e40 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676454569" status: 202 len: 0 microversion: 2.1 time: 0.047049 Sep 06 20:20:33.897653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 334/701] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 20:20:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676454569 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:20:35.340466 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-53d4184f-6174-4769-8c05-66d83f28ff1a req-d87dcf05-5596-4ca3-9896-bdcb6d6f6c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb7e4a2-f24c-4129-8d88-30e71c6d9f73", "tag": "5537e79d-e372-4591-84d5-3fd4a3bca85d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:35.359908 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-53d4184f-6174-4769-8c05-66d83f28ff1a req-d87dcf05-5596-4ca3-9896-bdcb6d6f6c6e service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:35.360398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-53d4184f-6174-4769-8c05-66d83f28ff1a req-d87dcf05-5596-4ca3-9896-bdcb6d6f6c6e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:35.364004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-53d4184f-6174-4769-8c05-66d83f28ff1a req-d87dcf05-5596-4ca3-9896-bdcb6d6f6c6e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:35.395058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-53d4184f-6174-4769-8c05-66d83f28ff1a req-d87dcf05-5596-4ca3-9896-bdcb6d6f6c6e service nova] Creating event network-changed:5537e79d-e372-4591-84d5-3fd4a3bca85d for instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 on hv-cinder-84773 Sep 06 20:20:35.411435 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-53d4184f-6174-4769-8c05-66d83f28ff1a req-d87dcf05-5596-4ca3-9896-bdcb6d6f6c6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071812 Sep 06 20:20:35.415165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 368/702] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:20:36.121561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8bf0200d-b71e-4716-9279-446fa8fee335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: .version_select at 0x7f9c3b8e0e50>, body: {"keypair": {"name": "tempest-keypair-772750874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX5Vzzz1SDvFG1PHJnZXXWt8rC2CBYmULIpX5NVJBgmkpNHm9MV6vg8YOMu+AOK6wjGaMBTdlJILMAjhZfb4atBauhNz2znwSVYnKrH6Bbvi7KGCyTJwHsdzRkDKsp1tQ=="}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:36.223867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-8bf0200d-b71e-4716-9279-446fa8fee335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:20:36.236350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-8bf0200d-b71e-4716-9279-446fa8fee335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:20:36.296492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8bf0200d-b71e-4716-9279-446fa8fee335 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190909 Sep 06 20:20:36.298798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 335/703] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:20:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:37.588487 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-08b2c408-29a2-4885-8ea0-77c395c84fe2 req-3a9348a1-b8cd-4677-aedb-ec738a1add01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bb7e4a2-f24c-4129-8d88-30e71c6d9f73", "tag": "5537e79d-e372-4591-84d5-3fd4a3bca85d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:37.663727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-08b2c408-29a2-4885-8ea0-77c395c84fe2 req-3a9348a1-b8cd-4677-aedb-ec738a1add01 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:37.669747 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-08b2c408-29a2-4885-8ea0-77c395c84fe2 req-3a9348a1-b8cd-4677-aedb-ec738a1add01 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:37.673160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-08b2c408-29a2-4885-8ea0-77c395c84fe2 req-3a9348a1-b8cd-4677-aedb-ec738a1add01 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:37.765177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-08b2c408-29a2-4885-8ea0-77c395c84fe2 req-3a9348a1-b8cd-4677-aedb-ec738a1add01 service nova] Creating event network-changed:5537e79d-e372-4591-84d5-3fd4a3bca85d for instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 on hv-cinder-84773 Sep 06 20:20:37.801594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-08b2c408-29a2-4885-8ea0-77c395c84fe2 req-3a9348a1-b8cd-4677-aedb-ec738a1add01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230284 Sep 06 20:20:37.805439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 369/704] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:38.521395 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:38.522322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:38.537275 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:38.538859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:38.540850 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:38.545073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:38.547099 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:38.549217 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:38.628645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-088d768c-e9b8-4cc9-9e9e-4d3552704b8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments/b6f849bc-f8e1-4960-9600-94dc94c0ebce" status: 200 len: 194 microversion: 2.20 time: 0.562616 Sep 06 20:20:38.629499 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 336/705] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Sep 6 20:20:38 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments/b6f849bc-f8e1-4960-9600-94dc94c0ebce => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:20:38.770806 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:38.772296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:38.779384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:38.780288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:38.781198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:38.782637 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:38.783390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:38.784473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:38.894948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lazy-loading 'services' on Instance uuid c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:39.070935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-474438ef-2224-4c71-bc3c-513632f04a07 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments/b6f849bc-f8e1-4960-9600-94dc94c0ebce" status: 202 len: 0 microversion: 2.20 time: 0.305156 Sep 06 20:20:39.071900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 370/706] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Sep 6 20:20:38 2022] DELETE /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments/b6f849bc-f8e1-4960-9600-94dc94c0ebce => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 20:20:39.084801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:39.087803 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:39.096469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:39.097506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:39.098211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:39.099219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:39.100126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:39.100836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:39.159178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b7222e6c-f0f6-4f90-b3ec-2bfb6cfb0ae2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080147 Sep 06 20:20:39.160469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 337/707] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 20:20:39 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:20:40.193397 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:40.204932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:40.244428 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:40.245719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:40.246869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:40.248502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:40.249667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:40.250767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:40.311786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-647075859", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1afac54-5c6c-4b09-a9a4-d3257ac1482d"}], "security_groups": [{"name": "tempest-securitygroup--1780752417"}], "key_name": "tempest-keypair-772750874", "user_data": "}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:40.358642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c2ec5a79-c7e2-4c93-a499-cf2b0367a1a7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184062 Sep 06 20:20:40.360079 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 371/708] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 20:20:40 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:20:40.557886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] validate_networks() for [('d1afac54-5c6c-4b09-a9a4-d3257ac1482d', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:20:41.376202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:41.378882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:41.395996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:41.397220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:41.398435 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:41.399951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:41.403508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:41.404773 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:41.486467 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:20:41.488391 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:20:41.490480 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:20:41.491655 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:20:41.492571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:20:41.505597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-77546360-4fbb-4971-896c-575899fad5a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134130 Sep 06 20:20:41.510643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:41.512871 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:41.513054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 372/709] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 20:20:41 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:20:41.513673 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:41.514844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:41.515515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:41.516140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:41.540677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:20:41.546790 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:20:41.563324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:20:41.567511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:20:41.633879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d23fb4b2-2d56-481b-b1e4-9c8fa7b0d3d3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.329934 Sep 06 20:20:41.634608 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 338/710] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:20:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 20:20:41.650624 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fc4c3acf-7453-4ddb-8739-c29db0dcbfec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:41.666865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fc4c3acf-7453-4ddb-8739-c29db0dcbfec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:41.820396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fc4c3acf-7453-4ddb-8739-c29db0dcbfec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:41.845925 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fc4c3acf-7453-4ddb-8739-c29db0dcbfec tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1240 microversion: 2.1 time: 0.201027 Sep 06 20:20:41.847933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 373/711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:41 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1240 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:42.526833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:42.529522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:42.555033 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:42.558134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:42.558940 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:42.560144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:42.562694 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:42.563895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:42.666367 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1a658ed2-1ce0-48eb-b435-87ff80e23fc9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.144695 Sep 06 20:20:42.711523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 339/712] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 20:20:42 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:42.839990 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:42.844002 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:42.884250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5564d7b6-76b8-4218-a67e-82caf3edc7e2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:42.884860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:42.885266 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5564d7b6-76b8-4218-a67e-82caf3edc7e2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:42.891001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:42.893205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:42.895203 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:42.897159 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:42.898559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:42.980874 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:42.995569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:20:43.098207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5564d7b6-76b8-4218-a67e-82caf3edc7e2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:43.127302 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5564d7b6-76b8-4218-a67e-82caf3edc7e2 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1240 microversion: 2.1 time: 0.245615 Sep 06 20:20:43.131967 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 340/713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:42 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1240 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:43.304480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6c3420e7-d085-4cb9-8bd7-5d01601e9ecf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 204 len: 0 microversion: 2.20 time: 0.472173 Sep 06 20:20:43.307011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 374/714] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 20:20:42 2022] DELETE /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 20:20:43.318656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:43.319269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:43.331787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:43.332453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:43.334901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:43.337124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:43.337928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:43.338683 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:43.653302 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:43.663913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:43.665597 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:43.666685 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7fba76c1-1c2c-4215-8c9b-038ce88edcd9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.352467 Sep 06 20:20:43.678123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 341/715] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:43 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:44.186189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:44.187733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:44.202406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:44.203297 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:44.204205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:44.205517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:44.206462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:44.207228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:44.311866 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:44.323243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-453ede5e-8fd1-47ed-b471-8447f64bc0d0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1244 microversion: 2.1 time: 0.145569 Sep 06 20:20:44.337645 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 375/716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:44 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1244 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:44.706360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:44.708078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:44.723141 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:44.723948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:44.725959 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:44.726743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:44.731802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:44.732460 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:45.162284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:45.177573 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:45.180435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:45.182554 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-54aa4d5c-541a-4edc-b775-d92a6c141c3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.480797 Sep 06 20:20:45.183699 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 342/717] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:44 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:45.355235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:45.357794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:45.371712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:45.373221 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:45.374518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:45.377188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:45.378550 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:45.379704 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:45.543143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:45.580154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-dce3fb50-901a-438f-b420-1b0f32bfb383 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1236 microversion: 2.1 time: 0.230856 Sep 06 20:20:45.581369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 376/718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:45 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1236 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:46.231285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:46.234392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:46.248777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:46.257925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:46.259193 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:46.259607 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:46.260496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:46.261223 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:46.617255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:46.618526 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:46.631933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:46.636012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:46.636764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:46.638118 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:46.638826 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:46.639525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:46.756698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:46.775613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bf7059d8-d597-4c1f-9aae-0310834d0ed9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1292 microversion: 2.1 time: 0.165259 Sep 06 20:20:46.790783 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 377/719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:46 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1292 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:46.860784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:46.894393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:46.904278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:46.918386 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-14e5eff0-617d-4887-9947-2fab5e8b8045 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1723 microversion: 2.20 time: 0.693606 Sep 06 20:20:46.919819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 343/720] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:46 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:47.819027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:47.819876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:47.841054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:47.842037 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:47.842748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:47.846044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:47.848963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:47.849408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:47.954424 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:47.963928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:47.966837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:47.979929 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-29553929-64e9-4405-98d2-ebba695e01df tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1298 microversion: 2.1 time: 0.166933 Sep 06 20:20:47.994723 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 378/721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:47 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:48.005525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:48.008994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:48.011903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:48.017580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:48.021820 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:48.026249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:48.318601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-f1494c21-aa7f-49c7-af50-c330d92ff409 req-fb792643-e5a2-4430-a749-ec3c90231610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f6b5ee-95cf-4e73-8124-578bcbcd7c19", "name": "network-vif-deleted", "tag": "9eaa793d-1594-4913-b5c0-8b0669ff04be"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:48.333682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-f1494c21-aa7f-49c7-af50-c330d92ff409 req-fb792643-e5a2-4430-a749-ec3c90231610 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:48.334164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-f1494c21-aa7f-49c7-af50-c330d92ff409 req-fb792643-e5a2-4430-a749-ec3c90231610 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:48.334860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-f1494c21-aa7f-49c7-af50-c330d92ff409 req-fb792643-e5a2-4430-a749-ec3c90231610 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:48.358796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-f1494c21-aa7f-49c7-af50-c330d92ff409 req-fb792643-e5a2-4430-a749-ec3c90231610 service nova] Creating event network-vif-deleted:9eaa793d-1594-4913-b5c0-8b0669ff04be for instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 on hv-cinder-84773 Sep 06 20:20:48.366715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:48.375543 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-f1494c21-aa7f-49c7-af50-c330d92ff409 req-fb792643-e5a2-4430-a749-ec3c90231610 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274604 Sep 06 20:20:48.377117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 379/722] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:48.383300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:48.390032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:48.392128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-27af8ee0-4bad-4aea-8424-adb5f0c8a16b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1656 microversion: 2.20 time: 0.444952 Sep 06 20:20:48.392725 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 344/723] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:47 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1656 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:49.017367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:49.018756 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:49.044360 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:49.044870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:49.045316 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:49.046091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:49.046563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:49.047173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:49.421577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:49.423034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:49.426154 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:49.434908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:49.435679 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:49.436282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:49.437560 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:49.439093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:49.439799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:49.497361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:49.512675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-86f00619-7459-4259-a803-8777267d3e4a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.508115 Sep 06 20:20:49.513210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 380/724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:49 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:49.604183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:49.605487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:49.606571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:49.609490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lazy-loading 'fault' on Instance uuid c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:20:49.688966 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:49.718191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:49.722235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:49.724723 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c5e08896-833e-4d11-a1d6-b823cd8141c6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 200 len: 1372 microversion: 2.20 time: 0.307400 Sep 06 20:20:49.742502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 345/725] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:49 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:50.545485 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:50.548439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:50.557586 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:50.558108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:50.558648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:50.559281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:50.560952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:50.563236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:50.762697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-26d94b61-f430-439c-b5a3-12fd3ca671d0 req-3f2934c2-45b8-4911-b2a1-04e4a7bf34e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf0941f-e94c-48a0-b1a3-7848bce394f7", "tag": "b4d95048-ddbe-4599-ae1d-e88c4bc230c2"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:50.802368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-26d94b61-f430-439c-b5a3-12fd3ca671d0 req-3f2934c2-45b8-4911-b2a1-04e4a7bf34e6 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:50.804563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-26d94b61-f430-439c-b5a3-12fd3ca671d0 req-3f2934c2-45b8-4911-b2a1-04e4a7bf34e6 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:50.807982 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-26d94b61-f430-439c-b5a3-12fd3ca671d0 req-3f2934c2-45b8-4911-b2a1-04e4a7bf34e6 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:50.831286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:50.865782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d0e128c0-5b1e-460d-ae23-c0446848893c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.326537 Sep 06 20:20:50.868083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 381/726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:50 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:50.877095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:50.877834 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-26d94b61-f430-439c-b5a3-12fd3ca671d0 req-3f2934c2-45b8-4911-b2a1-04e4a7bf34e6 service nova] Creating event network-changed:b4d95048-ddbe-4599-ae1d-e88c4bc230c2 for instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 on hv-cinder-84773 Sep 06 20:20:50.883982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:50.892979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:50.894198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:50.894893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:50.895874 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:50.896562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:50.897938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:50.900399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-26d94b61-f430-439c-b5a3-12fd3ca671d0 req-3f2934c2-45b8-4911-b2a1-04e4a7bf34e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145170 Sep 06 20:20:50.901660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 346/727] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:50.924743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] HTTP exception thrown: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Request method failure captured: Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 HTTP/1.1 Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6peVt_ERWMvj63kiV2hwj5u9lcUXUlN3s0GMpw3DA0SZfOjPQSm58BR7pxnrlv2oIfZzp0qyLcuiOkbjq2ZFTYBLNak96kVD-GlphfcCq-XE_gRzudNNyLvfd5LxdQzj2eb7yhkMZkQmofKsB5dSS1P2DorpSCV5IX3FwRlDh9_TsQ Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:20:50.927188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 7be957f2c15c4f6f949b3f284a30624d Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:20:50.929228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'c0f6b5ee-95cf-4e73-8124-578bcbcd7c19'} Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:20:50.930058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:20:50.931296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:20:50.934612 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Returning 404 to user: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:20:50.935956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-99d9be81-4b82-4de9-90b8-41380101f12b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 404 len: 111 microversion: 2.20 time: 0.066358 Sep 06 20:20:50.937126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 382/728] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:50 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 20:20:50.955091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-01abbdfb-82a6-4d86-9685-58c1d6f9e156 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '.version_select at 0x7f9c3bab2670>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:50.981724 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-01abbdfb-82a6-4d86-9685-58c1d6f9e156 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733328091" status: 204 len: 0 microversion: 2.20 time: 0.036142 Sep 06 20:20:50.982661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 347/729] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 6 20:20:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733328091 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 20:20:51.916607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:51.919167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:51.937692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:51.946412 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:51.959022 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:51.959956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:51.961328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:51.962251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:51.963005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:52.466729 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:52.491586 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-02cdfe19-d28b-40da-92d5-af55cb29aafa tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.582417 Sep 06 20:20:52.492702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 383/730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:51 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:52.581269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:52.587707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0f204d3c-5666-4b8b-aa87-1d281e6f1be6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'create', calling method: .version_select at 0x7f9c3b988820>, body: {"keypair": {"name": "tempest-keypair-980359669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvVP0e/IbRONgOIANLWsHWTzks4Ie8A2j/SAPhSPP3iJe2UZ1TmIQlqhiVWa0PvS2AdfkHY3ITe2NxcXVRnZgOJOdI7nEcUzEXZc5NLUL2+QdZQHw3oAKYT1eAv08q0Lw=="}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:52.624691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-0f204d3c-5666-4b8b-aa87-1d281e6f1be6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:20:52.631443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-0f204d3c-5666-4b8b-aa87-1d281e6f1be6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for user 7be957f2c15c4f6f949b3f284a30624d and project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:20:52.680168 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0f204d3c-5666-4b8b-aa87-1d281e6f1be6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.099732 Sep 06 20:20:52.680786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 348/731] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 6 20:20:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 06 20:20:53.543684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:53.546230 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:53.576035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:53.576035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:53.576035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:53.577127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:53.578347 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:53.580091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:54.140850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:54.156772 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-80106714-d865-4ae6-87a4-764f13a154ea tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.626848 Sep 06 20:20:54.159959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 384/732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:53 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:54.980801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b0e88e6a-b384-45b6-930d-78e71bb01133 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Action: 'create', calling method: .version_select at 0x7f9c3b8ee790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1083295294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXy3q/OOZsHt1rYG+4iXnRhHua+qJKS+0t6s4E3K+2ALdTrhlDx3xk3/xIVW2I9ZYzJghCFfJMgRGj5nvPT2bneojTrmLEvi+PdaFJWt6dIk5NuV+FxdvATRJaaiRbJsQ=="}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:55.012600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-b0e88e6a-b384-45b6-930d-78e71bb01133 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Getting quotas for project 48d7280f7ee04d389193da7bf05eaf1a. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:20:55.020016 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-b0e88e6a-b384-45b6-930d-78e71bb01133 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Getting quotas for user a385e6b1f23d449f8738a6f87720184d and project 48d7280f7ee04d389193da7bf05eaf1a. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:20:55.062786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b0e88e6a-b384-45b6-930d-78e71bb01133 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.088880 Sep 06 20:20:55.063812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 349/733] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:20:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:55.136835 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1258698727", "imageRef": "60923a40-3dc2-4177-982c-ebcde2940560", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1083295294", "networks": [{"uuid": "ff3ee576-2b35-4d53-8b3c-3c652308cfd1"}]}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:55.149104 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:55.208542 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:55.209526 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:55.223882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:55.224511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:55.225715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:55.227194 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:55.227911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:55.228869 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:55.234784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:55.241052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] validate_networks() for [('ff3ee576-2b35-4d53-8b3c-3c652308cfd1', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:20:55.575852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:55.590131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-afd41756-db81-4770-af9d-06bd5890a004 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.385258 Sep 06 20:20:55.591426 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 350/734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:55 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:55.630425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-288777712", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "912564fd-af22-4c52-b66c-ce5ba337c4b5"}], "security_groups": [{"name": "tempest-securitygroup--1157403767"}], "key_name": "tempest-keypair-980359669", "user_data": "}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:55.797063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] validate_networks() for [('912564fd-af22-4c52-b66c-ce5ba337c4b5', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:20:56.466790 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:20:56.467783 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:20:56.468133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:20:56.468679 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:20:56.469168 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:20:56.482190 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:56.482805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:56.483485 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:56.484463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:56.485131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:56.486425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:56.509136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:20:56.519057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Getting quotas for user 7be957f2c15c4f6f949b3f284a30624d and project d0bdb5e8899b4766b797688ad00c7ce0. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:20:56.542177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:20:56.546881 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:20:56.601020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:20:56.601818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:20:56.603248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:20:56.604270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:20:56.605238 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:20:56.623904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:56.624589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:56.625450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:56.627075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:56.627894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:56.628679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:56.677477 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f36874f8-ed06-4861-84e6-5950b8f8087d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.059627 Sep 06 20:20:56.689707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 351/735] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 6 20:20:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 20:20:56.689996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Getting quotas for project 48d7280f7ee04d389193da7bf05eaf1a. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:20:56.694200 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Getting quotas for user a385e6b1f23d449f8738a6f87720184d and project 48d7280f7ee04d389193da7bf05eaf1a. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:20:56.697643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:56.698337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:56.720596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:56.722162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:56.722162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:56.722836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:56.723473 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:56.727713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:56.733279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:20:56.736414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60923a40-3dc2-4177-982c-ebcde2940560',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:20:56.809254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a53952f1-eab4-47c3-a459-1d2c50303e2f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677723 Sep 06 20:20:56.811505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 385/736] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:20:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:20:56.823531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-276c0568-d9ad-40a7-8d57-12aaa4fcc2f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:56.826441 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-276c0568-d9ad-40a7-8d57-12aaa4fcc2f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:56.969398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-276c0568-d9ad-40a7-8d57-12aaa4fcc2f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:57.008021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-276c0568-d9ad-40a7-8d57-12aaa4fcc2f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:57.012882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:57.015292 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-276c0568-d9ad-40a7-8d57-12aaa4fcc2f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:57.024058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7ecfa920-5cec-4cef-a478-a4b347b92f1d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.339058 Sep 06 20:20:57.025253 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 352/737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:56 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:57.025457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-276c0568-d9ad-40a7-8d57-12aaa4fcc2f5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1280 microversion: 2.20 time: 0.210909 Sep 06 20:20:57.030869 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3af28ba5-9b75-4a14-a7ac-5455ab015b9d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:57.032220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3af28ba5-9b75-4a14-a7ac-5455ab015b9d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:57.035407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 386/738] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:56 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:57.124740 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3af28ba5-9b75-4a14-a7ac-5455ab015b9d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:57.135370 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3af28ba5-9b75-4a14-a7ac-5455ab015b9d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1259 microversion: 2.1 time: 0.108682 Sep 06 20:20:57.137568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 353/739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:57 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1259 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:57.715536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-0439d6cf-4d51-4a51-8216-21722113d18c req-2785fecc-32be-4397-8e08-1631745a39f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf0941f-e94c-48a0-b1a3-7848bce394f7", "name": "network-vif-plugged", "status": "completed", "tag": "b4d95048-ddbe-4599-ae1d-e88c4bc230c2"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:20:57.731941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0439d6cf-4d51-4a51-8216-21722113d18c req-2785fecc-32be-4397-8e08-1631745a39f7 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:57.732569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0439d6cf-4d51-4a51-8216-21722113d18c req-2785fecc-32be-4397-8e08-1631745a39f7 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:57.733101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0439d6cf-4d51-4a51-8216-21722113d18c req-2785fecc-32be-4397-8e08-1631745a39f7 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:57.748477 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-0439d6cf-4d51-4a51-8216-21722113d18c req-2785fecc-32be-4397-8e08-1631745a39f7 service nova] Creating event network-vif-plugged:b4d95048-ddbe-4599-ae1d-e88c4bc230c2 for instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 on hv-cinder-84773 Sep 06 20:20:57.755380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-0439d6cf-4d51-4a51-8216-21722113d18c req-2785fecc-32be-4397-8e08-1631745a39f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319768 Sep 06 20:20:57.756230 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 387/740] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:20:58.069650 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:58.071916 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:58.085643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:58.086554 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:58.087354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:58.088626 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:58.089534 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:58.090519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:58.091302 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:58.095274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:58.126164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:58.127025 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:58.127650 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:58.128910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:58.129589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:58.130148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:58.253166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:58.262743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:58.264361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:58.265514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-14bddd4a-8d4b-4e4b-b22c-69dcab615cbf tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1332 microversion: 2.20 time: 0.183313 Sep 06 20:20:58.267537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 388/741] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:58 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1332 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:58.280078 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:58.281153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:58.292207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:58.293139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:58.293791 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:58.294725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:58.295386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:58.295981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:58.360256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:58.371145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1f59e5b9-92a5-4c1b-838e-dc08607f4263 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.310044 Sep 06 20:20:58.372046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 354/742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:58 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:58.414432 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:58.429277 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9a877b20-41a8-4aed-a6c8-41b97c646650 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1255 microversion: 2.1 time: 0.159857 Sep 06 20:20:58.430430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 389/743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:58 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1255 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:20:59.313003 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:59.314359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:59.321864 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:59.322356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:59.322793 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:59.323584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:59.324041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:59.324468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:59.401508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:59.412068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:59.412643 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:59.413534 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:59.413780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:59.414806 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c74c0a39-34a2-4ca1-8f97-f48263343c73 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1332 microversion: 2.20 time: 0.106073 Sep 06 20:20:59.415383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 355/744] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:20:59 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:20:59.425689 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:59.426537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:59.427317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:59.428624 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:59.429479 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:59.430348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:59.459815 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:20:59.460963 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:20:59.472099 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:59.472921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:59.473707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:59.475009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:20:59.475830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:20:59.476616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:20:59.572100 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:59.582081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4777b3b1-13dc-43cd-9c8c-6d8c2959f460 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1255 microversion: 2.1 time: 0.130185 Sep 06 20:20:59.582788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 356/745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:59 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1255 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:20:59.646181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:20:59.661342 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-70219168-363c-4250-a725-d1d5da1e76a3 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1366 microversion: 2.1 time: 0.256544 Sep 06 20:20:59.662453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 390/746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:20:59 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:00.440440 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:00.441228 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:00.451071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:00.451821 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:00.452613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:00.454053 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:00.455335 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:00.455980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:00.543937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:00.558709 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:00.562373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:00.565215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c5351902-7a6d-4a12-9e9f-9c458d8bf449 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1340 microversion: 2.20 time: 0.129216 Sep 06 20:21:00.569685 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 357/747] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:00 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1340 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:00.611780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:00.612872 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:00.625732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:00.628282 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:00.629272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:00.630782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:00.631916 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:00.632998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:00.692862 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:00.707545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:00.727154 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:00.728999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:00.729863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:00.731594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:00.733007 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:00.733817 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:00.812183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:00.829390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-106f4fc8-1312-4ff1-806b-0261fed50e1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1311 microversion: 2.1 time: 0.224707 Sep 06 20:21:00.831265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 391/748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:00 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1311 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:01.069052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:01.077408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-be34e0c0-ad09-4dee-9e2b-76f9bda93902 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1556 microversion: 2.1 time: 0.394736 Sep 06 20:21:01.078052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 358/749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:00 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1556 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:01.101372 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:01.101903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:01.108152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:01.108657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:01.109096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:01.109849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:01.110807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:01.111234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:01.215601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ec8f2ae1-b737-4d91-983b-fd1bef7131cd tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117983 Sep 06 20:21:01.216905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 392/750] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:21:01 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:01.611276 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:01.613838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:01.627619 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:01.631525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:01.633116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:01.634741 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:01.636140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:01.637320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:01.815102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:01.829672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:01.833101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:01.834813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-20326595-d2bb-4bf3-933f-6624326bb9f7 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1338 microversion: 2.20 time: 0.231081 Sep 06 20:21:01.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 359/751] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:01 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1338 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:21:01.871294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:01.873894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:01.885852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:01.887031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:01.888444 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:01.890852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:01.892247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:01.894148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:01.937381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:02.094386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:02.126710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ff7b7158-6237-4809-9551-88e11521ab18 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1319 microversion: 2.1 time: 0.262525 Sep 06 20:21:02.132923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 393/752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:01 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:02.869987 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:02.872684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:02.900645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:02.901955 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:02.903063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:02.905256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:02.906678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:02.908635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:03.239832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-5f68b428-f9d8-4cd0-82cb-5a492b19026f req-b1c6d49b-56f9-48ce-87b5-773690acbb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf0941f-e94c-48a0-b1a3-7848bce394f7", "tag": "b4d95048-ddbe-4599-ae1d-e88c4bc230c2"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:03.259140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-5f68b428-f9d8-4cd0-82cb-5a492b19026f req-b1c6d49b-56f9-48ce-87b5-773690acbb66 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:03.262341 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-5f68b428-f9d8-4cd0-82cb-5a492b19026f req-b1c6d49b-56f9-48ce-87b5-773690acbb66 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:03.262341 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-5f68b428-f9d8-4cd0-82cb-5a492b19026f req-b1c6d49b-56f9-48ce-87b5-773690acbb66 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:03.279097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-5f68b428-f9d8-4cd0-82cb-5a492b19026f req-b1c6d49b-56f9-48ce-87b5-773690acbb66 service nova] Creating event network-changed:b4d95048-ddbe-4599-ae1d-e88c4bc230c2 for instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 on hv-cinder-84773 Sep 06 20:21:03.290812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-5f68b428-f9d8-4cd0-82cb-5a492b19026f req-b1c6d49b-56f9-48ce-87b5-773690acbb66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381862 Sep 06 20:21:03.304438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 394/753] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:03.304438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:03.309649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:03.315571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:03.316259 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:03.316846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:03.317897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:03.318620 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:03.319246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:03.347600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:03.375199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:03.379751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:03.383656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-13a3404a-332f-4a02-b018-69756790a09a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.521757 Sep 06 20:21:03.385954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 360/754] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:02 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:21:03.449139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:03.464370 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-213c609b-535c-4484-9f91-c797f6f2ba99 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1317 microversion: 2.1 time: 0.166725 Sep 06 20:21:03.465878 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 395/755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:03 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:04.446037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:04.450043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:04.477579 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:04.481139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:04.482744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:04.486135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:04.487918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:04.490159 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:04.510123 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:04.512262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:04.543963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:04.547079 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:04.548294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:04.549932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:04.551098 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:04.552131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:04.939668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:04.960325 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bbe8a079-dc47-47f6-ae35-ebf8db64fad3 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.457386 Sep 06 20:21:04.962354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 396/756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:04 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:05.201176 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:05.238440 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:05.242625 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:05.253661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3e8f9388-239c-4a7f-a562-cc78bfc56e53 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.817334 Sep 06 20:21:05.270334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 361/757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:04 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:05.393678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-b98a4d93-27f2-46ff-b8eb-c237f5e0ca1f req-9051a38e-ae6a-4c34-94d4-c75436cc2a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53ac635-8d07-41f0-97d5-f0e81e70b51b", "tag": "26463c3c-fa68-45c1-9baa-cb0cf6ff34ec"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:05.433789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-b98a4d93-27f2-46ff-b8eb-c237f5e0ca1f req-9051a38e-ae6a-4c34-94d4-c75436cc2a3f service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:05.434472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-b98a4d93-27f2-46ff-b8eb-c237f5e0ca1f req-9051a38e-ae6a-4c34-94d4-c75436cc2a3f service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:05.434836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-b98a4d93-27f2-46ff-b8eb-c237f5e0ca1f req-9051a38e-ae6a-4c34-94d4-c75436cc2a3f service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:05.469381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-b98a4d93-27f2-46ff-b8eb-c237f5e0ca1f req-9051a38e-ae6a-4c34-94d4-c75436cc2a3f service nova] Creating event network-changed:26463c3c-fa68-45c1-9baa-cb0cf6ff34ec for instance a53ac635-8d07-41f0-97d5-f0e81e70b51b on hv-cinder-84773 Sep 06 20:21:05.483849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-b98a4d93-27f2-46ff-b8eb-c237f5e0ca1f req-9051a38e-ae6a-4c34-94d4-c75436cc2a3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111217 Sep 06 20:21:05.484855 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 397/758] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:21:05.993166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:05.994434 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:06.003282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:06.003905 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:06.004545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:06.005279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:06.005857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:06.006374 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:06.193525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:06.201863 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8a3ec08f-46db-4bed-aa80-52a0f630e7b0 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.220234 Sep 06 20:21:06.202495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 362/759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:05 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:06.305981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:06.307141 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:06.321453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:06.322845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:06.323940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:06.325702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:06.326605 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:06.327461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:06.525173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:06.535944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:06.538067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:06.540187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e867652c-092a-4c21-a0e7-3a4a6953f5eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.243885 Sep 06 20:21:06.541637 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 398/760] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:06 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:07.226284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:07.227010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:07.229210 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:07.230397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=28 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:07.240018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:07.240513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:07.240954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:07.241698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:07.242160 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:07.242735 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:07.471882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:07.487718 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-765a8ffe-4105-47d6-9cad-ab8cf7679254 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.265037 Sep 06 20:21:07.502413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 363/761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:07 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:07.571012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:07.572696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:07.575450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:07.576280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=8 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:07.585301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:07.586086 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:07.586738 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:07.587744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:07.588366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:07.588893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:07.794635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:07.814404 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:07.818005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:07.820498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3f5ffe06-69b1-45b4-b7b3-4c920edcf7ea tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.255812 Sep 06 20:21:07.834917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 399/762] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:07 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:08.551382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:08.553737 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:08.570330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.571285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.572104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.573529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.574465 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.575499 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.624374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:08.628120 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:08.637074 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.638069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.639070 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.640525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.642229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.643115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.687294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-161c7741-280c-419f-b80d-094fd1a6796e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071423 Sep 06 20:21:08.695048 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 400/763] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:08 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 20:21:08.793435 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:08.793959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:08.801028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.801685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.802178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.802942 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.803457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.803898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.831872 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:21:08.858250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:08.878454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0511b077-0d63-4725-bb9e-d65e4b47b141 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.349436 Sep 06 20:21:08.879434 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 364/764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:08 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:08.886891 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:08.888632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:08.914674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.916025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.917006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.918625 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.919836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.920947 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.968300 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-06e36988-d329-4f2e-8d63-ecf2411838e3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 204 len: 0 microversion: 2.1 time: 0.178129 Sep 06 20:21:08.974097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 401/765] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:21:08 2022] DELETE /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:21:08.980326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:08.981139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:08.989017 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.989556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.990108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:08.990923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:08.991452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:08.991975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:09.152450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:09.163642 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:09.165993 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:09.167243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-da25d304-6016-4163-8f15-86dad0aa0edb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.285928 Sep 06 20:21:09.168187 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 365/766] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:08 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:09.210130 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:09.219335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1e215154-5100-47f5-9747-f0007ebda33e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1674 microversion: 2.1 time: 0.243554 Sep 06 20:21:09.221662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 402/767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:08 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:09.921901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:09.923057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:09.936217 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:09.936818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:09.937354 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:09.938900 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:09.939584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:09.940101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:10.158142 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:10.167932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-12ceee71-e8a7-4dd9-87a0-fa55500f6757 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.253245 Sep 06 20:21:10.168540 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 366/768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:09 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:10.196650 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:10.197533 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:10.211488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:10.212444 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:10.213278 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:10.214828 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:10.215754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:10.216539 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:10.252924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:10.261390 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:10.283564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:10.284609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:10.285506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:10.286952 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:10.291441 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:10.292603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:10.505271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:10.521982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:10.525469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:10.528047 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5b885a3a-34bc-43b0-a089-487f3ff23b61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.338129 Sep 06 20:21:10.529515 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 403/769] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:10 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:10.599795 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:10.608648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-84f07fc3-1600-45bd-a7fe-5be144d7f519 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1674 microversion: 2.1 time: 0.363591 Sep 06 20:21:10.609446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 367/770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:10 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1674 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:11.193481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:11.194251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:11.201105 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:11.201873 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:11.202065 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:11.202788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:11.203300 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:11.204474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:11.415173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:11.434203 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9b3583b3-7020-4cb4-b3fe-3fbb91cba1d4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.244071 Sep 06 20:21:11.435901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 404/771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:11 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:11.572778 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:11.573968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:11.583501 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:11.584314 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:11.585063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:11.586311 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:11.587315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:11.588066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:11.625940 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:11.639463 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:11.646675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:11.654006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:11.654503 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:11.654969 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:11.655697 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:11.656164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:11.657231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:11.829585 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:11.847441 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:11.852427 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:11.854849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-060b3776-aed3-4cf9-89eb-0b1df91683eb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.288070 Sep 06 20:21:11.856635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 368/772] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:11 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:11.932765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:11.942355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0ac0a7d4-15c2-4a92-8bf5-8da51c927976 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1674 microversion: 2.1 time: 0.308438 Sep 06 20:21:11.954117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 405/773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:11 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1674 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:12.488964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:12.489743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:12.512243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:12.513084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:12.513895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:12.515139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:12.516446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:12.517183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:12.726521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:12.735494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b1a06f0b-90bb-4c37-a5a5-6f7c5c349400 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.258173 Sep 06 20:21:12.736791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 369/774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:12 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:12.892450 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:12.893215 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:12.902434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:12.903279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:12.904003 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:12.905461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:12.907243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:12.908236 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:12.968383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:12.969588 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:12.978685 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:12.979907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:12.980737 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:12.981780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:12.982811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:12.983504 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:13.130601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:13.142062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:13.145533 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:13.147112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-da7a3061-0769-46d8-9d96-43827ea04476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.259772 Sep 06 20:21:13.155368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 406/775] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:12 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:13.208178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:13.217250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a15ba860-4df2-46bc-90bb-4c881269e2b9 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1674 microversion: 2.1 time: 0.253632 Sep 06 20:21:13.217951 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 370/776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:12 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:13.432232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:13.433270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:13.444948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:13.445898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:13.446717 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:13.448010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:13.448867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:13.449683 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:13.570962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lazy-loading 'services' on Instance uuid 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:21:13.659680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8346e3ca-d27e-4b9e-8727-ffc23d84d035 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments/4b616e49-5605-411c-b77c-6b8dd7b4203c" status: 202 len: 0 microversion: 2.1 time: 0.235059 Sep 06 20:21:13.660388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 407/777] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:21:13 2022] DELETE /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments/4b616e49-5605-411c-b77c-6b8dd7b4203c => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:21:13.672242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:13.676583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:13.691063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:13.691764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:13.692383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:13.693505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:13.694190 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:13.694785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:13.749840 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-13aebe9b-d146-4225-8fcb-66cada163f10 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083857 Sep 06 20:21:13.751154 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 371/778] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:13 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:13.774069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:13.775372 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:13.792999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:13.794249 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:13.795090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:13.796471 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:13.797887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:13.804668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:14.018528 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:14.028665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a1032ad6-38e4-4be3-9e1c-eddf9cde0ddc tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.263109 Sep 06 20:21:14.030625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 408/779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:13 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:14.174212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:14.174937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:14.181574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:14.182097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:14.182532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:14.183386 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:14.183698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:14.184125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:14.244241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:14.244983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:14.252364 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:14.252872 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:14.253309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:14.254280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:14.254536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:14.254980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:14.259921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:14.421161 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:14.430243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-313df813-1b2f-499d-97ea-5c1c8a013a43 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1674 microversion: 2.1 time: 0.190043 Sep 06 20:21:14.431288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 409/780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:14 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:14.654479 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:14.670498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:14.674348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:14.676616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-16308210-d8f7-43da-8e2e-4dc0ebf78b78 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.506328 Sep 06 20:21:14.677735 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 372/781] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:14 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:14.763911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:14.767156 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:14.774283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:14.774922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:14.775371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:14.776144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:14.776686 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:14.777130 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:14.815288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-dfab54c8-db97-4f28-989d-7bd3e4a9d821 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055315 Sep 06 20:21:14.815803 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 410/782] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:14 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:15.057325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:15.058640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:15.069827 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.070415 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.071464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.072617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.074162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.074324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.458970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:15.461098 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:15.474722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.476034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.476933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.478745 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.484644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.493505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:15.494988 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.504804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-175f3416-1637-426f-9f86-8e7eebd5dd30 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.454409 Sep 06 20:21:15.506260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 373/783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:15 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:15.620269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-b6a2cd8a-fe1b-4197-b62e-07d5294ea075 req-827b5039-2838-4281-95fe-f4758d1bbb00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefab8aa-8f04-40bf-b79e-8d360f621421", "tag": "03bf2ca5-99d4-4234-8de2-d6f243ea50d8"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:15.627732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:15.638406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b6a2cd8a-fe1b-4197-b62e-07d5294ea075 req-827b5039-2838-4281-95fe-f4758d1bbb00 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.639242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b6a2cd8a-fe1b-4197-b62e-07d5294ea075 req-827b5039-2838-4281-95fe-f4758d1bbb00 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.641442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b6a2cd8a-fe1b-4197-b62e-07d5294ea075 req-827b5039-2838-4281-95fe-f4758d1bbb00 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.661229 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-b6a2cd8a-fe1b-4197-b62e-07d5294ea075 req-827b5039-2838-4281-95fe-f4758d1bbb00 service nova] Creating event network-changed:03bf2ca5-99d4-4234-8de2-d6f243ea50d8 for instance cefab8aa-8f04-40bf-b79e-8d360f621421 on hv-cinder-84773 Sep 06 20:21:15.665551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-b6a2cd8a-fe1b-4197-b62e-07d5294ea075 req-827b5039-2838-4281-95fe-f4758d1bbb00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052920 Sep 06 20:21:15.666525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 374/784] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:15.685635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:15.695313 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-98e79f67-f394-4a38-bcf4-37f0b66a6686 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1674 microversion: 2.1 time: 0.241367 Sep 06 20:21:15.695993 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 411/785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:15 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:15.725056 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:15.725848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:15.732750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.733247 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.733767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.734560 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.735021 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.735454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.833392 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:15.837381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:15.850175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.850974 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.851774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.853082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:15.854088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:15.854890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:15.931154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-17c86c6c-1127-4e76-bf07-ac5fefadec5e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105337 Sep 06 20:21:15.937008 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 412/786] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:15 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:21:16.014103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:16.030846 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:16.034424 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:16.036620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b6c13146-4d57-4fdb-9803-8dfb6fc0a1e4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.315732 Sep 06 20:21:16.037752 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 375/787] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:15 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:16.535744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:16.536857 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:16.549823 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:16.550653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:16.551451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:16.552773 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:16.553647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:16.554483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:16.724075 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:16.724681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:16.737944 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:16.738789 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:16.739804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:16.741081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:16.741936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:16.743073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:16.915105 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:16.936440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-55dd8913-4246-415b-b2ad-72aaede87396 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.408313 Sep 06 20:21:16.937710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 413/788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:16 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:16.965956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:16.969194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:16.978095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:16.978853 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:16.979501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:16.980436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:16.981068 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:16.981691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.020454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b61d28de-907e-4539-b922-2eb26f2a6307 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077707 Sep 06 20:21:17.027987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 414/789] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:16 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 20:21:17.069938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:17.072006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:17.083327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.084560 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.085538 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.087068 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.087879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.088617 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.290057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:17.300836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e7774f58-cfac-4b15-83b4-9155df1f72a0 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1674 microversion: 2.1 time: 0.583562 Sep 06 20:21:17.301511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 376/790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:16 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1674 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:17.307157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:17.307823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:17.316294 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.317285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.318045 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.319134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.319856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.320763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.327094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:17.337474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:17.339234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:17.340437 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-aa892f99-7ce6-4699-b750-5450ba26e8d5 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.278945 Sep 06 20:21:17.353112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 415/791] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:17 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:17.367698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:21:17.467475 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-82ac8aaf-537f-45fd-bf3f-4a94706c6bc8 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 204 len: 0 microversion: 2.1 time: 0.164497 Sep 06 20:21:17.467982 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 377/792] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:21:17 2022] DELETE /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:21:17.476763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:17.477398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:17.484737 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.485239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.485725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.486500 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.487052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.487473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.659749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:17.669818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6583a972-c305-4451-9910-e92fa78c195e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1689 microversion: 2.1 time: 0.197108 Sep 06 20:21:17.670593 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 416/793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:17 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:17.964195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:17.971894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:17.980080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.980760 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.981279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:17.982260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:17.982837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:17.983286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.084637 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-3f894ea2-d8a9-4d3e-9af9-5082fcebb088 req-5997eaa9-8366-4c27-b129-2889bae47c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f25258-270e-479e-b6d2-5dc39da2f3a5", "name": "network-vif-deleted", "tag": "576fc76a-50fd-4ff9-80cc-ee131fbb00c3"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:18.108638 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3f894ea2-d8a9-4d3e-9af9-5082fcebb088 req-5997eaa9-8366-4c27-b129-2889bae47c7e service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:18.110227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3f894ea2-d8a9-4d3e-9af9-5082fcebb088 req-5997eaa9-8366-4c27-b129-2889bae47c7e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:18.111374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3f894ea2-d8a9-4d3e-9af9-5082fcebb088 req-5997eaa9-8366-4c27-b129-2889bae47c7e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.136570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-3f894ea2-d8a9-4d3e-9af9-5082fcebb088 req-5997eaa9-8366-4c27-b129-2889bae47c7e service nova] Creating event network-vif-deleted:576fc76a-50fd-4ff9-80cc-ee131fbb00c3 for instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 on hv-cinder-84773 Sep 06 20:21:18.146963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-3f894ea2-d8a9-4d3e-9af9-5082fcebb088 req-5997eaa9-8366-4c27-b129-2889bae47c7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071981 Sep 06 20:21:18.148391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 417/794] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:18.229998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:18.249012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4f887cae-0a3e-451f-9a93-95335dfec7e9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.290642 Sep 06 20:21:18.250609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 378/795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:17 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:18.330079 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:18.330975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:18.339000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:18.339686 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:18.340314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.341255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:18.341895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:18.342423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.375205 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:18.376514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:18.387427 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:18.388163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:18.388914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.390008 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:18.391240 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:18.392934 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.442067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:18.451147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4cd84787-864c-48a4-9992-4201a386a3d6 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1323 microversion: 2.1 time: 0.127423 Sep 06 20:21:18.452498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 418/796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:18 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1323 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:18.612528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:18.622553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:18.625295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:18.626937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-361a9d01-398b-4557-b671-982c8918a912 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.260056 Sep 06 20:21:18.627536 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 379/797] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:18 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:18.705331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:18.706121 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:18.714051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:18.714711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:18.715272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.716133 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:18.716813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:18.717344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:18.917162 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:18.927390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0836a3b5-7131-4553-83ca-4b5b88293f20 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1689 microversion: 2.1 time: 0.226369 Sep 06 20:21:18.928318 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 419/798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:18 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:19.291404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:19.292834 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:19.302830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.303773 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.304459 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:19.305810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.306630 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.307441 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:19.490051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:19.491136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:19.493326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:19.503781 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.504628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.505390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:19.506902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.507696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.508651 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:19.512549 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-079c617d-765b-4f9d-bb7b-c8fc1824ea69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.224520 Sep 06 20:21:19.519166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 380/799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:19 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:19.615542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:19.631107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8e8008c5-8173-4bb2-affc-4186aace7c84 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1323 microversion: 2.1 time: 0.153836 Sep 06 20:21:19.632145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 420/800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:19 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:19.660143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:19.661108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:19.668910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.669451 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.669924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:19.670839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.671419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.671854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:19.891743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:19.900867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:19.902403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:19.903835 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-460e4207-c74a-4fdf-8b68-08663d5bcb8f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.253871 Sep 06 20:21:19.904518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 381/801] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:19 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:19.966821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:19.967395 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:19.974581 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.975095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.975540 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:19.976360 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:19.976781 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:19.977234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:20.175286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:20.185357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-69339ba4-54db-4086-84c9-7e2bb42fb719 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1689 microversion: 2.1 time: 0.222550 Sep 06 20:21:20.186383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 421/802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:19 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:20.553224 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:20.554112 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:20.563416 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:20.564278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:20.565029 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:20.566018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:20.566552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:20.567245 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:20.665787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:20.666589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:20.673940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:20.674790 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:20.675313 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:20.676147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:20.676644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:20.677093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:20.745247 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:20.756315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-cb7ffaed-93cf-4e68-9b6b-b396d8b4ab00 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.207447 Sep 06 20:21:20.757352 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 382/803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:20 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:20.760887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:20.770774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7c9ad29b-8691-443e-98af-d26409b57b36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1323 microversion: 2.1 time: 0.109457 Sep 06 20:21:20.771732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 422/804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:20 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1323 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:20.930893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:20.931559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:20.938759 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:20.939263 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:20.939708 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:20.940488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:20.940882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:20.941320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.101342 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:21.111144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:21.112606 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:21.113781 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bc5181e8-fc59-4541-8096-e74687cd1810 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.187314 Sep 06 20:21:21.114363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 383/805] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:20 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:21:21.214053 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:21.214966 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:21.220030 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:21.225923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.226426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.226863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.227584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.228217 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.228647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.300678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-d3b93088-a391-44f5-a6ef-1f9845e17ab3 req-77f2643e-eb75-49ee-abf7-37fd910af2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefab8aa-8f04-40bf-b79e-8d360f621421", "name": "network-vif-plugged", "status": "completed", "tag": "03bf2ca5-99d4-4234-8de2-d6f243ea50d8"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:21.319148 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d3b93088-a391-44f5-a6ef-1f9845e17ab3 req-77f2643e-eb75-49ee-abf7-37fd910af2c2 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.320054 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d3b93088-a391-44f5-a6ef-1f9845e17ab3 req-77f2643e-eb75-49ee-abf7-37fd910af2c2 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.320859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d3b93088-a391-44f5-a6ef-1f9845e17ab3 req-77f2643e-eb75-49ee-abf7-37fd910af2c2 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.330012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:21.341338 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-d3b93088-a391-44f5-a6ef-1f9845e17ab3 req-77f2643e-eb75-49ee-abf7-37fd910af2c2 service nova] Creating event network-vif-plugged:03bf2ca5-99d4-4234-8de2-d6f243ea50d8 for instance cefab8aa-8f04-40bf-b79e-8d360f621421 on hv-cinder-84773 Sep 06 20:21:21.348168 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-d3b93088-a391-44f5-a6ef-1f9845e17ab3 req-77f2643e-eb75-49ee-abf7-37fd910af2c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051846 Sep 06 20:21:21.349239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 384/806] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:21:21.415502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:21.426247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-18067403-2e68-41bc-a37a-5dd8f9c1d394 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1689 microversion: 2.1 time: 0.217836 Sep 06 20:21:21.429674 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 423/807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:21 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1689 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:21.787374 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:21.788410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:21.797268 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:21.798066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:21.798260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.798836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.799388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.800216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.800872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.801394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.805995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.806594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.808880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.808880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.808880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.808880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.853286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:21.853895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:21.854442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:21.854908 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lazy-loading 'fault' on Instance uuid 22f25258-270e-479e-b6d2-5dc39da2f3a5 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:21:21.929745 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:21.944870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-53e47ee2-50f5-4624-9085-aaae85a1c84d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1328 microversion: 2.1 time: 0.151842 Sep 06 20:21:21.945968 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 424/808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:21 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1328 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:22.005665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:22.021050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f3e9840b-530e-4ad3-a266-88f436b6482a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.239140 Sep 06 20:21:22.022171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 385/809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:21 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:22.142568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:22.143363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:22.157597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:22.158543 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:22.159340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:22.160647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:22.161506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:22.162328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:22.389260 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:22.399391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:22.401080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:22.402444 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4125f8f3-5dfa-4819-9508-fdf29fdc4260 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.265506 Sep 06 20:21:22.403049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 425/810] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:22 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:22.451267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:22.452392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:22.460351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:22.460915 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:22.461472 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:22.462435 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:22.462984 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:22.463468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:22.683100 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:22.693897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5358bab6-a182-46c4-8586-d3af62700194 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1689 microversion: 2.1 time: 0.246848 Sep 06 20:21:22.694958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 386/811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:22 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1689 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:22.988285 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:22.989372 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:23.008298 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.009435 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.010339 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.011760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.012876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.013718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.057277 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:23.065664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:23.066905 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:23.085648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.085975 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.086177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.086319 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.086978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.089321 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lazy-loading 'fault' on Instance uuid 22f25258-270e-479e-b6d2-5dc39da2f3a5 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:21:23.089786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.091788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.098140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.102889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.175891 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:23.189825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2d30916f-42ed-4745-b7a6-f29b2c6a1486 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1328 microversion: 2.1 time: 0.211282 Sep 06 20:21:23.194700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 426/812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:22 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1328 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:23.437963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:23.440152 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:23.455879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.457269 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.459473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.461633 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.462785 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.463762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.662769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:23.680278 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:23.682794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:23.685320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6e4af630-fe8c-47e7-b79b-34306098ae8d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.256363 Sep 06 20:21:23.686382 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 427/813] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:23 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:21:23.721925 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:23.722999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:23.733062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.735039 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.735992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.737337 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:23.738235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:23.739042 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:23.844980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:23.856652 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-83292c00-cca0-426a-b3bd-b24ca574f48a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1359 microversion: 2.1 time: 0.799701 Sep 06 20:21:23.870211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 387/814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:23 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1359 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:23.974779 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:23.990217 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ff1989ae-3bd0-4b5b-b2da-880c2e4f8eee tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1689 microversion: 2.1 time: 0.272384 Sep 06 20:21:24.006312 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 428/815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:23 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1689 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:24.226807 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:24.227896 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:24.241377 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.242311 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.243102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.244398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.245251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.246057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.316471 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.316972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.317417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.317948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lazy-loading 'fault' on Instance uuid 22f25258-270e-479e-b6d2-5dc39da2f3a5 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:21:24.402559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:24.434709 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d0a2c063-2a06-44fe-9a52-f57e19464762 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 200 len: 1328 microversion: 2.1 time: 0.215087 Sep 06 20:21:24.436817 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 388/816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:24 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 1328 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:24.505673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-d41f4751-547a-4c94-9d2a-5b5740ae2452 req-a6b04e77-f9a0-4b1e-b88c-350c0cf069c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bb7e4a2-f24c-4129-8d88-30e71c6d9f73", "name": "network-vif-deleted", "tag": "5537e79d-e372-4591-84d5-3fd4a3bca85d"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:24.523545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-d41f4751-547a-4c94-9d2a-5b5740ae2452 req-a6b04e77-f9a0-4b1e-b88c-350c0cf069c1 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.524261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-d41f4751-547a-4c94-9d2a-5b5740ae2452 req-a6b04e77-f9a0-4b1e-b88c-350c0cf069c1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.524887 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-d41f4751-547a-4c94-9d2a-5b5740ae2452 req-a6b04e77-f9a0-4b1e-b88c-350c0cf069c1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.548484 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-d41f4751-547a-4c94-9d2a-5b5740ae2452 req-a6b04e77-f9a0-4b1e-b88c-350c0cf069c1 service nova] Creating event network-vif-deleted:5537e79d-e372-4591-84d5-3fd4a3bca85d for instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 on hv-cinder-84773 Sep 06 20:21:24.557265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-d41f4751-547a-4c94-9d2a-5b5740ae2452 req-a6b04e77-f9a0-4b1e-b88c-350c0cf069c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057098 Sep 06 20:21:24.559801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 429/817] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:24.724573 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:24.725317 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:24.736075 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.736843 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.737601 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.739044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.739882 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.740675 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.883697 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:24.885346 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:24.896712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.897851 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.899054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.900457 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:24.901460 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:24.902614 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:24.937296 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:24.952998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:24.955456 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:24.957533 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9c72bc1b-015b-4073-9382-8eed8844c4b4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.236741 Sep 06 20:21:24.960958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 389/818] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:24 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:25.038317 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:25.039796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:25.050804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.051739 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.053740 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.054938 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.055586 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.056220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.195422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:25.208372 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-aa089fb9-a457-4906-99a5-d78c4ba16008 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 200 len: 1330 microversion: 2.1 time: 0.174281 Sep 06 20:21:25.213697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 390/819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:25 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 1330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:25.230414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:25.255707 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b38133f2-0c4c-4300-8fd8-eecc1c2f6b1b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1549 microversion: 2.1 time: 0.377188 Sep 06 20:21:25.257113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 430/820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:24 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1549 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:25.285569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:25.288910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:25.300364 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.301704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.302383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.303216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.303743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.304231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.485579 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:25.487146 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:25.502634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.504570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.506144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.511834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.512926 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.515124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.522864 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:25.543595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4d82c523-d4c7-444b-82f0-ae6c0257c9ac tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1549 microversion: 2.1 time: 0.258250 Sep 06 20:21:25.550377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] HTTP exception thrown: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Request method failure captured: Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 HTTP/1.1 Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pRlRTVlLxdqMeviE7q_y_xNZ3p7ejCxymVnpdp13db6bVnnl8v4DXL0c7AFjJAfVyY6NAz4yOtX_vF58wBdUak4I2gdVUyTD9-IWZTSFuhpGhUHb-57iF558zB3SASKK0W1WPWujBY3RSv7UI9kof_cqE-t2IeTx16DEpxo9cKn-U Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:21:25.554167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: f49ef54a38614cb880577626e65b0e32 Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:21:25.556836 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '22f25258-270e-479e-b6d2-5dc39da2f3a5'} Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:21:25.558252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:21:25.560555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:25.569220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 391/821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:25 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1549 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:25.571476 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Returning 404 to user: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:21:25.573688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f30e5ce0-e392-46ea-a925-d0d8c40e99c2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 404 len: 111 microversion: 2.1 time: 0.097746 Sep 06 20:21:25.573917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-41f32860-fcbe-4c11-a722-e49083e5b448 req-5798d07f-6cdf-4627-a0e7-d6624e6eee7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ac635-8d07-41f0-97d5-f0e81e70b51b", "name": "network-vif-plugged", "status": "completed", "tag": "26463c3c-fa68-45c1-9baa-cb0cf6ff34ec"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:25.576019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 431/822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:25 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:21:25.591808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-41f32860-fcbe-4c11-a722-e49083e5b448 req-5798d07f-6cdf-4627-a0e7-d6624e6eee7b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.593256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-41f32860-fcbe-4c11-a722-e49083e5b448 req-5798d07f-6cdf-4627-a0e7-d6624e6eee7b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.594094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-41f32860-fcbe-4c11-a722-e49083e5b448 req-5798d07f-6cdf-4627-a0e7-d6624e6eee7b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.608400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:25.610371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-41f32860-fcbe-4c11-a722-e49083e5b448 req-5798d07f-6cdf-4627-a0e7-d6624e6eee7b service nova] Creating event network-vif-plugged:26463c3c-fa68-45c1-9baa-cb0cf6ff34ec for instance a53ac635-8d07-41f0-97d5-f0e81e70b51b on hv-cinder-84773 Sep 06 20:21:25.617747 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-41f32860-fcbe-4c11-a722-e49083e5b448 req-5798d07f-6cdf-4627-a0e7-d6624e6eee7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050210 Sep 06 20:21:25.618994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 392/823] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:25.627126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-40713dfd-3ad2-4953-932d-cfa082946bdd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '.version_select at 0x7f9c3b8eeb80>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:25.630099 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:25.631726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Searching by: {'deleted': False, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a'} {{(pid=120952) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 20:21:25.651626 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.652534 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.653352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.653499 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-40713dfd-3ad2-4953-932d-cfa082946bdd tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336345385" status: 202 len: 0 microversion: 2.1 time: 0.032695 Sep 06 20:21:25.654134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 393/824] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 20:21:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336345385 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:21:25.654817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.656471 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.657265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.834103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.multi_cell_list [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120952) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 20:21:25.954568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c0e431ac-8292-478c-a8ea-8700e12c649c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.375839 Sep 06 20:21:25.968295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:25.969061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:25.974784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 432/825] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 6 20:21:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:25.977252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.977816 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.979971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:25.981037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:25.981713 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:25.982153 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:26.008478 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:26.009094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:26.019080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:26.019581 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:26.020019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:26.020734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:26.021290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:26.021754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:26.259692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:26.276841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:26.287748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:26.290486 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f142a9e1-7d61-417d-82ae-748acb987040 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.285565 Sep 06 20:21:26.291814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 433/826] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:26 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:21:26.306058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:26.308329 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:26.330625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:26.332075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:26.334983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:26.336855 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:26.344093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:26.345255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:26.372923 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] HTTP exception thrown: Instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 could not be found. Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Request method failure captured: Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 HTTP/1.1 Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pIzR1wGZoVZFCzLwuJtb60ZoHuW7x7VIRJBdTIgSLkhJ6MogAG81kphlJRWd2yzkQSH5VGRjxyve3vfCIJtUG5nSEMdNyhbgU5EgzTp213wFCnb7n7X7K58tvVQdM_JVlj8ckacBhgXuyLEUcNV8FfhX939pH7jINLvbt8aXN1D2o Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:21:26.375953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b005ff023a9f46fda3ceef605996c385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ecde3e4bfd8b4f3490edd3832cea9e48 Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 could not be found. Sep 06 20:21:26.378910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '6bb7e4a2-f24c-4129-8d88-30e71c6d9f73'} Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 could not be found. Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:21:26.382442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 could not be found. Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 could not be found. Sep 06 20:21:26.387143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:26.392168 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Returning 404 to user: Instance 6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:21:26.392168 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f8dc7aee-cd07-4537-9391-434185119dec tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73" status: 404 len: 111 microversion: 2.1 time: 0.084515 Sep 06 20:21:26.392168 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 434/827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:26 2022] GET /compute/v2.1/servers/6bb7e4a2-f24c-4129-8d88-30e71c6d9f73 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:21:26.392168 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4cfda16e-b189-4529-97c6-64ba320e1235 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '.version_select at 0x7f9c37956a60>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:26.425857 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4cfda16e-b189-4529-97c6-64ba320e1235 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158101110" status: 202 len: 0 microversion: 2.1 time: 0.039164 Sep 06 20:21:26.427304 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 435/828] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 20:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158101110 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:21:26.662496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:26.681953 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f7ef6469-b453-4a3e-91ca-05d30027bd05 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1549 microversion: 2.1 time: 0.717694 Sep 06 20:21:26.682655 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 394/829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:25 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1549 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:27.344898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:27.348961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:27.359938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:27.360630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:27.360862 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-07a18e22-2deb-49d1-a086-915984093ad2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'create', calling method: .version_select at 0x7f9c3bec1b80>, body: {"keypair": {"name": "tempest-keypair-1410650869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqYd7uEQI6NxbN+jRnISQplbo9AkhL5dhy6TXCH9Yapd0VGGRTkk2VyU8w33kH7brsCxpWEgojdO+4pGWlhZh9g2X/QWpFMlvtaMnXuWw0gcFEMR5TKP6os9lQVJGbCrA=="}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:27.361319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:27.362500 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:27.363388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:27.363961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:27.384263 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-07a18e22-2deb-49d1-a086-915984093ad2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:21:27.390205 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-07a18e22-2deb-49d1-a086-915984093ad2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for user f49ef54a38614cb880577626e65b0e32 and project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:21:27.423818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-07a18e22-2deb-49d1-a086-915984093ad2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070735 Sep 06 20:21:27.425057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 395/830] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:21:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:21:27.779011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:27.799196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:27.802397 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:27.804747 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3141b000-72e5-483d-aea0-0f1a4f390cc1 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1406 microversion: 2.20 time: 0.464883 Sep 06 20:21:27.805932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 436/831] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:27 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:21:28.749460 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c282c92f-7a26-4ebd-8862-3dd9a6564933"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:28.754157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:28.763356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:28.763957 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:28.765320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:28.766376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:28.766994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:28.767524 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:28.850545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:28.851999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:28.866444 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:28.867749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:28.868648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:28.870069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:28.870985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:28.872061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:29.112774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:29.128596 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:29.133537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:29.134114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-482ce94d-1311-47cc-959b-7b5e4ea362a9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1598 microversion: 2.20 time: 0.292676 Sep 06 20:21:29.135006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 437/832] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:21:28 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1598 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:21:29.172505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:29.173492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:29.180612 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:29.181169 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:29.182023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:29.182899 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:29.183511 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:29.184044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:29.284659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1a6c5aed-ecf3-49e8-84f2-fcbfca473176 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543353 Sep 06 20:21:29.287219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 396/833] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:21:28 2022] POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:29.343737 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-82e23e7a-453e-4b8b-ab75-a0b3bb1f7a3a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.175618 Sep 06 20:21:29.344693 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 438/834] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 6 20:21:29 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 20:21:29.887949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1495132002", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dacf4c35-a63a-4380-9dbf-e31cb5379429"}], "security_groups": [{"name": "tempest-securitygroup--744247597"}], "key_name": "tempest-keypair-1410650869", "user_data": "}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:30.057783 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] validate_networks() for [('dacf4c35-a63a-4380-9dbf-e31cb5379429', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:21:30.541363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:30.542716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:30.553664 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:30.554398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:30.555088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:30.556375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:30.557350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:30.558504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:30.618611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:21:30.708027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:21:30.708518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:21:30.708980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:21:30.709406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:21:30.709847 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:21:30.723138 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:30.724019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:30.724826 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:30.726545 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:30.727484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:30.727978 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:30.756508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:21:30.762669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Getting quotas for user f49ef54a38614cb880577626e65b0e32 and project 27f27bdf0ac14f62b682027b05b219ee. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:21:30.766757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-76efe156-7c02-44f4-92a3-a94b079e616f tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 204 len: 0 microversion: 2.1 time: 0.230562 Sep 06 20:21:30.768427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 439/835] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:21:30 2022] DELETE /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:21:30.784087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:21:30.790041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:21:30.790396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:30.790968 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:30.800696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:30.801196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:30.801699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:30.802439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:30.803029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:30.803366 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:30.882242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9000badd-c675-42ba-a1fd-afae28a04d3b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.004384 Sep 06 20:21:30.883489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 397/836] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:21:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:21:30.900841 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4aa8dfaf-2319-47ce-8efe-6549ca134fc3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:30.902080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4aa8dfaf-2319-47ce-8efe-6549ca134fc3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:31.010181 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4aa8dfaf-2319-47ce-8efe-6549ca134fc3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:31.027887 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4aa8dfaf-2319-47ce-8efe-6549ca134fc3 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1238 microversion: 2.1 time: 0.135178 Sep 06 20:21:31.029874 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 398/837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:30 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:31.067583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-9f5dc374-baa1-407f-bb8d-0ff46286dfca req-8e49d8e1-49c1-4a57-9940-2ade2f9d7fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53ac635-8d07-41f0-97d5-f0e81e70b51b", "tag": "26463c3c-fa68-45c1-9baa-cb0cf6ff34ec"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:31.091739 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9f5dc374-baa1-407f-bb8d-0ff46286dfca req-8e49d8e1-49c1-4a57-9940-2ade2f9d7fb5 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:31.093255 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9f5dc374-baa1-407f-bb8d-0ff46286dfca req-8e49d8e1-49c1-4a57-9940-2ade2f9d7fb5 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:31.094425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9f5dc374-baa1-407f-bb8d-0ff46286dfca req-8e49d8e1-49c1-4a57-9940-2ade2f9d7fb5 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:31.118518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-9f5dc374-baa1-407f-bb8d-0ff46286dfca req-8e49d8e1-49c1-4a57-9940-2ade2f9d7fb5 service nova] Creating event network-changed:26463c3c-fa68-45c1-9baa-cb0cf6ff34ec for instance a53ac635-8d07-41f0-97d5-f0e81e70b51b on hv-cinder-84773 Sep 06 20:21:31.123246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:31.127866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-9f5dc374-baa1-407f-bb8d-0ff46286dfca req-8e49d8e1-49c1-4a57-9940-2ade2f9d7fb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068270 Sep 06 20:21:31.129736 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 399/838] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:21:31.138340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-22d8ebd3-1520-4fad-baef-4e34906af826 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1507 microversion: 2.1 time: 0.362778 Sep 06 20:21:31.142924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 440/839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:30 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:32.061825 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:32.065124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:32.077032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:32.078397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:32.079194 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:32.080496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:32.081284 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:32.082065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:32.174091 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:32.175500 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:32.189840 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:32.191087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:32.192512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:32.194348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:32.195434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:32.196546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:32.306695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:32.322399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-19f5346a-f4a6-4707-a15d-84359e3d5d98 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1242 microversion: 2.1 time: 0.269704 Sep 06 20:21:32.323558 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 400/840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:32 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1242 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:32.471906 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:32.491304 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-94c4f49f-37db-43d7-adb8-8cc02d6763a9 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1507 microversion: 2.1 time: 0.324509 Sep 06 20:21:32.492849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 441/841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:32 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:33.368454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:33.369604 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:33.403457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:33.404363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:33.405300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:33.407012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:33.407868 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:33.408653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:33.530428 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:33.534599 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:33.535959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:33.543134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d3929c7c-227b-49ad-b2e0-966bd949eb6d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1308 microversion: 2.1 time: 0.181725 Sep 06 20:21:33.544095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:33.553778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:33.554052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 401/842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:33 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:33.554267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:33.554267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:33.554267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:33.554267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:33.692834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:33.703818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3c33a610-016f-47f6-953e-813944a52fa5 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1465 microversion: 2.1 time: 0.177991 Sep 06 20:21:33.704474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 442/843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:33 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1465 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:33.766668 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-9d4bff8b-21ab-47bc-8a3d-0c74c0556404 req-f22dc4c2-d2eb-4384-a36b-ce881d07327b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195da2b-23fc-4ec2-8c0e-69babd249087", "name": "network-vif-deleted", "tag": "339442d0-dfaf-4373-a89f-2acfe395baa1"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:33.790616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9d4bff8b-21ab-47bc-8a3d-0c74c0556404 req-f22dc4c2-d2eb-4384-a36b-ce881d07327b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:33.792039 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9d4bff8b-21ab-47bc-8a3d-0c74c0556404 req-f22dc4c2-d2eb-4384-a36b-ce881d07327b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:33.793161 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9d4bff8b-21ab-47bc-8a3d-0c74c0556404 req-f22dc4c2-d2eb-4384-a36b-ce881d07327b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:33.822132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-9d4bff8b-21ab-47bc-8a3d-0c74c0556404 req-f22dc4c2-d2eb-4384-a36b-ce881d07327b service nova] Creating event network-vif-deleted:339442d0-dfaf-4373-a89f-2acfe395baa1 for instance 3195da2b-23fc-4ec2-8c0e-69babd249087 on hv-cinder-84773 Sep 06 20:21:33.839975 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-9d4bff8b-21ab-47bc-8a3d-0c74c0556404 req-f22dc4c2-d2eb-4384-a36b-ce881d07327b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081688 Sep 06 20:21:33.843304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 402/844] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:34.608405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:34.611748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:34.647568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:34.649727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:34.650756 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:34.652309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:34.653257 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:34.654126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:34.745727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:34.747413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:34.759877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:34.761116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:34.762222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:34.764332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:34.765684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:34.766749 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:34.843867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:34.844720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:34.845500 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:34.846365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lazy-loading 'fault' on Instance uuid 3195da2b-23fc-4ec2-8c0e-69babd249087 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:21:34.968638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:34.987647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6703c760-bff9-40f6-8c73-bc5f810722e7 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 200 len: 1312 microversion: 2.1 time: 0.247642 Sep 06 20:21:35.004243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 403/845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:34 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:35.054374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:35.058711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:35.079067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d826d20d-5105-4889-9494-b9b210ed39d8 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.478688 Sep 06 20:21:35.080232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 443/846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:34 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:35.832328 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-2cc06281-e432-4ac0-a01a-3989bf2dbb1e req-c05a0d9b-da87-4b77-a6af-a82049d32ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6e2397-bd4a-4d38-8b85-fd89946ed9ef", "tag": "dc5481fe-dfff-4268-b210-bb8607c0792d"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:35.844629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:35.856836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2cc06281-e432-4ac0-a01a-3989bf2dbb1e req-c05a0d9b-da87-4b77-a6af-a82049d32ef5 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:35.857798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2cc06281-e432-4ac0-a01a-3989bf2dbb1e req-c05a0d9b-da87-4b77-a6af-a82049d32ef5 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:35.858599 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2cc06281-e432-4ac0-a01a-3989bf2dbb1e req-c05a0d9b-da87-4b77-a6af-a82049d32ef5 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:35.882066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-2cc06281-e432-4ac0-a01a-3989bf2dbb1e req-c05a0d9b-da87-4b77-a6af-a82049d32ef5 service nova] Creating event network-changed:dc5481fe-dfff-4268-b210-bb8607c0792d for instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef on hv-cinder-84773 Sep 06 20:21:35.891054 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-2cc06281-e432-4ac0-a01a-3989bf2dbb1e req-c05a0d9b-da87-4b77-a6af-a82049d32ef5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065756 Sep 06 20:21:35.892101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 404/847] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:36.028267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:36.031353 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 3195da2b-23fc-4ec2-8c0e-69babd249087] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:36.036660 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:36.046924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.047589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.047888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.048835 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.049197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.049705 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.068774 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] HTTP exception thrown: Instance 3195da2b-23fc-4ec2-8c0e-69babd249087 could not be found. Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Request method failure captured: Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 HTTP/1.1 Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pIzR1wGZoVZFCzLwuJtb60ZoHuW7x7VIRJBdTIgSLkhJ6MogAG81kphlJRWd2yzkQSH5VGRjxyve3vfCIJtUG5nSEMdNyhbgU5EgzTp213wFCnb7n7X7K58tvVQdM_JVlj8ckacBhgXuyLEUcNV8FfhX939pH7jINLvbt8aXN1D2o Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:21:36.070293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b005ff023a9f46fda3ceef605996c385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ecde3e4bfd8b4f3490edd3832cea9e48 Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 3195da2b-23fc-4ec2-8c0e-69babd249087 could not be found. Sep 06 20:21:36.072714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '3195da2b-23fc-4ec2-8c0e-69babd249087'} Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195da2b-23fc-4ec2-8c0e-69babd249087 could not be found. Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:21:36.074106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195da2b-23fc-4ec2-8c0e-69babd249087 could not be found. Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195da2b-23fc-4ec2-8c0e-69babd249087 could not be found. Sep 06 20:21:36.076458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:36.078679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Returning 404 to user: Instance 3195da2b-23fc-4ec2-8c0e-69babd249087 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:21:36.078679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d07d292d-14ab-44b1-a439-3684adf0102a tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087" status: 404 len: 111 microversion: 2.1 time: 0.051753 Sep 06 20:21:36.078679 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 444/848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:36 2022] GET /compute/v2.1/servers/3195da2b-23fc-4ec2-8c0e-69babd249087 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:21:36.086472 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:36.087349 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:36.097064 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.097569 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.098270 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.099164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.099776 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.100315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.107740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:36.108546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:36.117224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.117953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.118694 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.120564 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.121177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.121714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.138396 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:21:36.142516 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:36.259411 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f5509248-2b6c-4d08-ab13-2f6213cb23c3 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 204 len: 0 microversion: 2.1 time: 0.177459 Sep 06 20:21:36.260513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 405/849] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:21:36 2022] DELETE /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:21:36.277113 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:36.278702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:36.290904 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.291808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.292600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.293958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:36.295340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:36.296118 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:36.312897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:36.325522 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-125f1536-21cd-46e4-9ed5-44cb33949d4a tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.222290 Sep 06 20:21:36.342117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 445/850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:36 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:36.569310 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:36.578267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a689babb-d3e7-4a7c-b26a-f8d2e18411df tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.310048 Sep 06 20:21:36.578876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 406/851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:36 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:37.380064 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:37.380800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:37.388235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:37.388797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:37.389278 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:37.390090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:37.390610 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:37.391099 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:37.551201 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:37.560035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e14d80cf-4dc7-4803-a0be-935281d8e5c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.183947 Sep 06 20:21:37.561416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 446/852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:37 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:37.603032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:37.603750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:37.611048 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:37.611549 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:37.612022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:37.612753 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:37.613215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:37.613673 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:37.769433 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:37.784875 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7c8a5858-72af-4d59-a1ed-d367968d6677 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.185377 Sep 06 20:21:37.785799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 407/853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:37 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:38.603235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:38.604867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:38.616443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:38.617156 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:38.618293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:38.619681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:38.620381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:38.621026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:38.816373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:38.818374 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:38.833091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:38.833640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:38.834267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:38.835235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:38.835908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:38.836458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:38.838474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:38.853868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0f55020f-0d82-4ef8-860e-d0f9606d2e36 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.257672 Sep 06 20:21:38.854969 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 447/854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:38 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:39.012014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:39.023242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-55efc1ae-936b-41c4-beb0-e0abb4a33ecc tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1521 microversion: 2.1 time: 0.214547 Sep 06 20:21:39.024121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 408/855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:38 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:39.620922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:39.622007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:39.635007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:39.636303 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:39.637361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:39.639106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:39.648552 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:39.649868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:39.893563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:39.894503 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:39.902880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:39.903617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:39.904950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:39.906215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:39.906875 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:39.907444 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:40.112729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:40.128918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c5bdb8a6-e2d8-440a-ac17-6f6081fba708 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.239785 Sep 06 20:21:40.130207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 409/856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:39 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:40.135997 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:40.142177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-9278755c-c446-400e-9af1-073cb8df420e req-a5c59674-ae41-464a-bfff-eeabbbd994b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c", "name": "network-vif-deleted", "tag": "03b06557-9c5e-4e13-9df1-1d7acac27bc0"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:40.159575 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9278755c-c446-400e-9af1-073cb8df420e req-a5c59674-ae41-464a-bfff-eeabbbd994b1 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:40.159831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9278755c-c446-400e-9af1-073cb8df420e req-a5c59674-ae41-464a-bfff-eeabbbd994b1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:40.160453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-9278755c-c446-400e-9af1-073cb8df420e req-a5c59674-ae41-464a-bfff-eeabbbd994b1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:40.170325 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-db7640ec-d072-4484-b3f0-a9bfa29c663c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1595 microversion: 2.1 time: 0.555949 Sep 06 20:21:40.171196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 448/857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:39 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1595 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:40.178401 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:40.179629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:40.183997 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-9278755c-c446-400e-9af1-073cb8df420e req-a5c59674-ae41-464a-bfff-eeabbbd994b1 service nova] Creating event network-vif-deleted:03b06557-9c5e-4e13-9df1-1d7acac27bc0 for instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c on hv-cinder-84773 Sep 06 20:21:40.188682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:40.189327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:40.190405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:40.191576 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:40.192253 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:40.192859 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:40.193804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-9278755c-c446-400e-9af1-073cb8df420e req-a5c59674-ae41-464a-bfff-eeabbbd994b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059967 Sep 06 20:21:40.194960 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 410/858] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:40.308061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:40.323863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e4b8100b-762c-4596-837a-353d87854f33 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1479 microversion: 2.1 time: 0.150146 Sep 06 20:21:40.334607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 449/859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:40 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1479 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:41.162048 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:41.163086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:41.166324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:41.169022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=12 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:41.178824 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:41.180851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:41.181844 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:41.182884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:41.183553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:41.184434 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:41.357578 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:41.359121 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:41.367446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:41.368058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:41.368581 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:41.370415 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:41.371460 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:41.372192 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:41.384443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:41.404886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-54572a5a-3d5b-4e7d-a1e5-7b8c19370fc1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.247745 Sep 06 20:21:41.407233 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 411/860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:41 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:41.418220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:41.420148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:41.421269 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:41.422298 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lazy-loading 'fault' on Instance uuid 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:21:41.486708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecde3e4bfd8b4f3490edd3832cea9e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b005ff023a9f46fda3ceef605996c385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:41.498841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-08644add-5fe7-4770-8634-82547e8c7d3e tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 200 len: 1312 microversion: 2.1 time: 0.145750 Sep 06 20:21:41.505189 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 450/861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:41 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:42.450141 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:42.454298 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:42.464629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:42.466152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:42.466684 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:42.467520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:42.468666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:42.469017 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:42.536147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:42.537030 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] [instance: 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:42.545767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:42.546557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:42.547115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:42.548247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:42.548890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:42.549482 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:42.575744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] HTTP exception thrown: Instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c could not be found. Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Request method failure captured: Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c HTTP/1.1 Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pIzR1wGZoVZFCzLwuJtb60ZoHuW7x7VIRJBdTIgSLkhJ6MogAG81kphlJRWd2yzkQSH5VGRjxyve3vfCIJtUG5nSEMdNyhbgU5EgzTp213wFCnb7n7X7K58tvVQdM_JVlj8ckacBhgXuyLEUcNV8FfhX939pH7jINLvbt8aXN1D2o Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:21:42.578954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b005ff023a9f46fda3ceef605996c385"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b005ff023a9f46fda3ceef605996c385"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: b005ff023a9f46fda3ceef605996c385 Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1994522460 Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ecde3e4bfd8b4f3490edd3832cea9e48 Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1994522460-project Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c could not be found. Sep 06 20:21:42.580725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c'} Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c could not be found. Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:21:42.581792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c could not be found. Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c could not be found. Sep 06 20:21:42.583248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:42.585867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] Returning 404 to user: Instance 6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:21:42.585867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0346b739-c758-4b92-b937-2c7999bbae70 tempest-ServerRescueNegativeTestJSON-1994522460 tempest-ServerRescueNegativeTestJSON-1994522460-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c" status: 404 len: 111 microversion: 2.1 time: 0.050158 Sep 06 20:21:42.585867 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 451/862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:42 2022] GET /compute/v2.1/servers/6a4aa7c9-fde0-4064-bf21-0a6e80d20e2c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:21:42.696962 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:42.706296 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ec51704c-6421-4e5a-973f-b587958605ec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.264032 Sep 06 20:21:42.722180 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 412/863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:42 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:42.799398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-c313b4c2-e90f-4aae-9abd-6d3ab44b1e92 req-b1a13018-d282-47d4-836d-100b604f40d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefab8aa-8f04-40bf-b79e-8d360f621421", "tag": "03bf2ca5-99d4-4234-8de2-d6f243ea50d8"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:42.823130 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-c313b4c2-e90f-4aae-9abd-6d3ab44b1e92 req-b1a13018-d282-47d4-836d-100b604f40d3 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:42.823999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-c313b4c2-e90f-4aae-9abd-6d3ab44b1e92 req-b1a13018-d282-47d4-836d-100b604f40d3 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:42.824908 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-c313b4c2-e90f-4aae-9abd-6d3ab44b1e92 req-b1a13018-d282-47d4-836d-100b604f40d3 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:42.839906 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-c313b4c2-e90f-4aae-9abd-6d3ab44b1e92 req-b1a13018-d282-47d4-836d-100b604f40d3 service nova] Creating event network-changed:03bf2ca5-99d4-4234-8de2-d6f243ea50d8 for instance cefab8aa-8f04-40bf-b79e-8d360f621421 on hv-cinder-84773 Sep 06 20:21:42.849139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-c313b4c2-e90f-4aae-9abd-6d3ab44b1e92 req-b1a13018-d282-47d4-836d-100b604f40d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058551 Sep 06 20:21:42.850286 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 452/864] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:43.461395 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-680bcda1-f56b-49d9-bd81-793a36e39bc6 req-667eaed5-3429-4aab-b1c1-10db87d0f239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6e2397-bd4a-4d38-8b85-fd89946ed9ef", "name": "network-vif-plugged", "status": "completed", "tag": "dc5481fe-dfff-4268-b210-bb8607c0792d"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:43.502810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-680bcda1-f56b-49d9-bd81-793a36e39bc6 req-667eaed5-3429-4aab-b1c1-10db87d0f239 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:43.503698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-680bcda1-f56b-49d9-bd81-793a36e39bc6 req-667eaed5-3429-4aab-b1c1-10db87d0f239 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:43.504498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-680bcda1-f56b-49d9-bd81-793a36e39bc6 req-667eaed5-3429-4aab-b1c1-10db87d0f239 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:43.540914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-680bcda1-f56b-49d9-bd81-793a36e39bc6 req-667eaed5-3429-4aab-b1c1-10db87d0f239 service nova] Creating event network-vif-plugged:dc5481fe-dfff-4268-b210-bb8607c0792d for instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef on hv-cinder-84773 Sep 06 20:21:43.550306 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-680bcda1-f56b-49d9-bd81-793a36e39bc6 req-667eaed5-3429-4aab-b1c1-10db87d0f239 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100336 Sep 06 20:21:43.555014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 413/865] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:43.735517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:43.736565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:43.753145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:43.757554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:43.758233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:43.762279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:43.764542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:43.768456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:44.680286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-36989193"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:44.682613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:44.695238 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:44.696082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:44.697331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:44.699037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:44.700740 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:44.701873 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:44.707018 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:44.720356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-cf1df8ab-9bfe-4bbe-9f0e-f317ad5a2e2e tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.990364 Sep 06 20:21:44.722202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 453/866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:43 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:44.947176 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.network.security_group_api [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Adding security group c99d5d4c-0dc7-4d4c-82b2-145d23e2cde1 to port 03bf2ca5-99d4-4234-8de2-d6f243ea50d8 Sep 06 20:21:45.656201 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:45.657253 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:45.672084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:45.672787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:45.674672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:45.675617 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:45.676422 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:45.677675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:45.730735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2f763828-0c6d-4eb1-9242-e43956b1dc2f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/ips" status: 200 len: 150 microversion: 2.1 time: 0.082947 Sep 06 20:21:45.732808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 454/867] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:21:45 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:45.771788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:45.774897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:45.802227 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f04d7165-c4f7-4ce3-a66b-7b7c0ecfba0e tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/action" status: 202 len: 0 microversion: 2.1 time: 1.131133 Sep 06 20:21:45.804808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 414/868] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:21:44 2022] POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:21:45.843406 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:45.844443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:45.853028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:45.853940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:45.854711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:45.855969 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:45.878960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:45.880414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:45.918645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:45.924622 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:45.940405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:45.952909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:45.953756 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:45.954532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:46.365267 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:46.377488 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-267f70f7-6906-47e2-a3dd-f660159db6de tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1758 microversion: 2.1 time: 0.565966 Sep 06 20:21:46.378839 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 415/869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:45 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1758 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:46.384678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-e54ff65c-c3fd-4e7a-b0a5-ffa48576feb6 req-c6377562-1b02-410e-81e2-1f97a35419d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefab8aa-8f04-40bf-b79e-8d360f621421", "tag": "03bf2ca5-99d4-4234-8de2-d6f243ea50d8"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:46.396813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-e54ff65c-c3fd-4e7a-b0a5-ffa48576feb6 req-c6377562-1b02-410e-81e2-1f97a35419d6 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:46.397864 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-e54ff65c-c3fd-4e7a-b0a5-ffa48576feb6 req-c6377562-1b02-410e-81e2-1f97a35419d6 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:46.398537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-e54ff65c-c3fd-4e7a-b0a5-ffa48576feb6 req-c6377562-1b02-410e-81e2-1f97a35419d6 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:46.426386 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-e54ff65c-c3fd-4e7a-b0a5-ffa48576feb6 req-c6377562-1b02-410e-81e2-1f97a35419d6 service nova] Creating event network-changed:03bf2ca5-99d4-4234-8de2-d6f243ea50d8 for instance cefab8aa-8f04-40bf-b79e-8d360f621421 on hv-cinder-84773 Sep 06 20:21:46.432831 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-e54ff65c-c3fd-4e7a-b0a5-ffa48576feb6 req-c6377562-1b02-410e-81e2-1f97a35419d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052168 Sep 06 20:21:46.435351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 416/870] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:46.516990 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:46.534267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f9aa8ee0-7321-4636-8c91-ca2ec4e94166 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1363 microversion: 2.1 time: 0.775819 Sep 06 20:21:46.572261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 455/871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:45 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1363 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:21:47.584482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:47.585347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:47.593189 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:47.594481 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:47.594989 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:47.595963 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:47.596614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:47.597110 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:47.783380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cc923e6-0c5a-48b2-96fa-dd35e378d0a9"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:47.789047 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:47.799431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:47.799940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:47.800411 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:47.801271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:47.802013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:47.802819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:47.942330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:47.971187 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d465b796-a908-4551-b5fd-68461fc5169d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1550 microversion: 2.1 time: 0.391098 Sep 06 20:21:47.972191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 417/872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:47 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1550 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:21:48.004034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:48.005281 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:48.018294 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:48.019140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:48.019914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:48.021312 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:48.022571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:48.023576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:48.198060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-112cce59-ced5-45dd-82af-7f295c4505bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201609 Sep 06 20:21:48.199165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 418/873] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:21:47 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:21:48.338176 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4cf981d2-ae81-4fe3-94e6-d8534d8564f8 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559527 Sep 06 20:21:48.339400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 456/874] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:21:47 2022] POST /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:50.342660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-d9b32c4c-bd5b-4e2e-90df-f2c84437b20e req-8d14509b-1039-4622-8621-6c2c57188af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6e2397-bd4a-4d38-8b85-fd89946ed9ef", "tag": "dc5481fe-dfff-4268-b210-bb8607c0792d"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:50.353842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d9b32c4c-bd5b-4e2e-90df-f2c84437b20e req-8d14509b-1039-4622-8621-6c2c57188af1 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:50.354849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d9b32c4c-bd5b-4e2e-90df-f2c84437b20e req-8d14509b-1039-4622-8621-6c2c57188af1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:50.355401 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d9b32c4c-bd5b-4e2e-90df-f2c84437b20e req-8d14509b-1039-4622-8621-6c2c57188af1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:50.369228 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-d9b32c4c-bd5b-4e2e-90df-f2c84437b20e req-8d14509b-1039-4622-8621-6c2c57188af1 service nova] Creating event network-changed:dc5481fe-dfff-4268-b210-bb8607c0792d for instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef on hv-cinder-84773 Sep 06 20:21:50.379495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-d9b32c4c-bd5b-4e2e-90df-f2c84437b20e req-8d14509b-1039-4622-8621-6c2c57188af1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046084 Sep 06 20:21:50.380294 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 419/875] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:21:56.350696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cc923e6-0c5a-48b2-96fa-dd35e378d0a9"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:21:56.354953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:56.360069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:56.371641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:56.372597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:56.373340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:56.374602 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:56.375387 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:56.376110 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:56.489241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Invalid volume: volume 4cc923e6-0c5a-48b2-96fa-dd35e378d0a9 is already attached to instances: 3bf0941f-e94c-48a0-b1a3-7848bce394f7 Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: POST /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments HTTP/1.1 Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 74 Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:21:56.491630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {"volumeAttachment": {"volumeId": "4cc923e6-0c5a-48b2-96fa-dd35e378d0a9"}} Sep 06 20:21:56.493761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Invalid volume: volume 4cc923e6-0c5a-48b2-96fa-dd35e378d0a9 is already attached to instances: 3bf0941f-e94c-48a0-b1a3-7848bce394f7 Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'server_id': '3bf0941f-e94c-48a0-b1a3-7848bce394f7', 'body': {'volumeAttachment': {'volumeId': '4cc923e6-0c5a-48b2-96fa-dd35e378d0a9'}}} Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4cc923e6-0c5a-48b2-96fa-dd35e378d0a9 is already attached to instances: 3bf0941f-e94c-48a0-b1a3-7848bce394f7 Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:56.494894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4cc923e6-0c5a-48b2-96fa-dd35e378d0a9 is already attached to instances: 3bf0941f-e94c-48a0-b1a3-7848bce394f7 Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:21:56.496497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4cc923e6-0c5a-48b2-96fa-dd35e378d0a9 is already attached to instances: 3bf0941f-e94c-48a0-b1a3-7848bce394f7 Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 400 to user: Invalid volume: volume 4cc923e6-0c5a-48b2-96fa-dd35e378d0a9 is already attached to instances: 3bf0941f-e94c-48a0-b1a3-7848bce394f7 {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7bc73c37-73f6-48dc-8e1c-ba7cb95876b7 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.150849 Sep 06 20:21:56.498158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 457/876] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:21:56 2022] POST /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 20:21:56.584795 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:56.585971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:56.595072 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:56.595820 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:56.596576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:56.597581 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:56.598213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:56.598819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:56.729413 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'services' on Instance uuid 3bf0941f-e94c-48a0-b1a3-7848bce394f7 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:21:56.937973 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f63aa607-3060-4a40-8dda-3c7cd7353df0 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments/4cc923e6-0c5a-48b2-96fa-dd35e378d0a9" status: 202 len: 0 microversion: 2.1 time: 0.358110 Sep 06 20:21:56.951031 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 420/877] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:21:56 2022] DELETE /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments/4cc923e6-0c5a-48b2-96fa-dd35e378d0a9 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:21:56.962515 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:56.969003 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:56.984223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:56.986004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:56.986567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:56.987618 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:56.988895 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:56.989704 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:57.051647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-907460a4-fe47-430d-bbb5-92f85efdecff tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105189 Sep 06 20:21:57.054191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 458/878] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:56 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:58.072250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:58.075555 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:58.084285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:58.084763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:58.085520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:58.086504 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:58.087280 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:58.087878 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:58.128617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7aa86e8d-b5f6-41f8-95e2-a60fe693e4ee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061907 Sep 06 20:21:58.129211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 421/879] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:58 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:21:59.145426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:59.147975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:59.156045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:59.156602 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:59.157139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:59.158026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:59.158596 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:59.159108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:59.204182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-52540004-9fd4-450c-bfa0-98d113fd413e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062895 Sep 06 20:21:59.204769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 459/880] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:21:59 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 20:21:59.280224 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:59.281297 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:59.288973 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:59.289452 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:59.289918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:59.290750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:59.291222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:59.291653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:59.326878 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:21:59.358272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:59.442145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fb1743d1-e298-48ae-a429-6c4183b0d041 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 204 len: 0 microversion: 2.1 time: 0.166676 Sep 06 20:21:59.442763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 422/881] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:21:59 2022] DELETE /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:21:59.452561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:21:59.454060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:21:59.460501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:59.460989 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:59.461550 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:59.462377 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:21:59.462911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:21:59.463431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:21:59.661147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:21:59.677106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f8672ec7-a5cf-48c5-96d3-62fb69d9a262 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1681 microversion: 2.1 time: 0.228271 Sep 06 20:21:59.678296 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 460/882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:21:59 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:00.703733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:00.704477 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:00.712675 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:00.713179 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:00.713645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:00.714400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:00.715378 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:00.715813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:00.893085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:00.908884 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7175607d-5793-47b6-986b-2bb96dd82c06 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1681 microversion: 2.1 time: 0.208704 Sep 06 20:22:00.910047 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 423/883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:00 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:01.939850 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:01.940841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:01.953002 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:01.954316 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:01.955506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:01.957080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:01.958216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:01.959205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:01.997939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:02.355060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:02.394483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8b301b04-e799-4125-ae4c-ba520e0bc1af tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1681 microversion: 2.1 time: 0.462554 Sep 06 20:22:02.395418 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 461/884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:01 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1681 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:02.900058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-b92b612a-457d-4212-91e2-1cecd4701819 req-39039920-cc11-408c-9add-01fe524e4a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf0941f-e94c-48a0-b1a3-7848bce394f7", "name": "network-vif-deleted", "tag": "b4d95048-ddbe-4599-ae1d-e88c4bc230c2"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:02.914894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b92b612a-457d-4212-91e2-1cecd4701819 req-39039920-cc11-408c-9add-01fe524e4a9b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:02.915993 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b92b612a-457d-4212-91e2-1cecd4701819 req-39039920-cc11-408c-9add-01fe524e4a9b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:02.916723 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b92b612a-457d-4212-91e2-1cecd4701819 req-39039920-cc11-408c-9add-01fe524e4a9b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:02.935363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-b92b612a-457d-4212-91e2-1cecd4701819 req-39039920-cc11-408c-9add-01fe524e4a9b service nova] Creating event network-vif-deleted:b4d95048-ddbe-4599-ae1d-e88c4bc230c2 for instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 on hv-cinder-84773 Sep 06 20:22:02.948353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-b92b612a-457d-4212-91e2-1cecd4701819 req-39039920-cc11-408c-9add-01fe524e4a9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055871 Sep 06 20:22:02.949325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 424/885] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:03.447292 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:03.448340 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:03.460239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:03.461420 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:03.462739 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:03.464579 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:03.466456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:03.467209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:03.539869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:03.540628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:03.541428 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:03.542305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'fault' on Instance uuid 3bf0941f-e94c-48a0-b1a3-7848bce394f7 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:22:03.635750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:03.651007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9ad89f9b-773d-4b80-9b64-52c70b1544b5 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 200 len: 1330 microversion: 2.1 time: 0.209345 Sep 06 20:22:03.652935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 462/886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:03 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 1330 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:04.679812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:04.680521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:04.690515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:04.691059 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:04.691582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:04.692192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:04.692623 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:04.693050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:04.709006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 HTTP/1.1 Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:22:04.710980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:22:04.712780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '3bf0941f-e94c-48a0-b1a3-7848bce394f7'} Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:22:04.713954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:22:04.715964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:22:04.717518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:22:04.717518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1a35f044-3702-4c27-8cab-99bf01ffd362 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 404 len: 111 microversion: 2.1 time: 0.037191 Sep 06 20:22:04.717518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 425/887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:04 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:22:04.724075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-46bb3f25-3b5d-4f1e-b147-e88edfb87269 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '.version_select at 0x7f9c3f2280d0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:04.757480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-46bb3f25-3b5d-4f1e-b147-e88edfb87269 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772750874" status: 202 len: 0 microversion: 2.1 time: 0.038456 Sep 06 20:22:04.758611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 463/888] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 20:22:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772750874 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:22:05.612631 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-13d5a8b9-fff8-4dfa-baed-7faa4e30b08d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: .version_select at 0x7f9c3b8df700>, body: {"keypair": {"name": "tempest-keypair-856679363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaSHq6wNA6TI4a6nm+LA9Yd1vP67zNbnPNIYXxL0ytpndMrWd0kGFbWdm4B8CLoVlUvgTRqoUQt2Nb3SVScpX25ku0sGOFE5kW4bRAmVqc2x3l0wh391DNoOWaE4luYDQ=="}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:05.637893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-13d5a8b9-fff8-4dfa-baed-7faa4e30b08d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:22:05.646489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-13d5a8b9-fff8-4dfa-baed-7faa4e30b08d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:22:05.690596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-13d5a8b9-fff8-4dfa-baed-7faa4e30b08d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.082105 Sep 06 20:22:05.691650 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 426/889] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:22:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:22:07.789399 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-335647109", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1afac54-5c6c-4b09-a9a4-d3257ac1482d"}], "security_groups": [{"name": "tempest-securitygroup--1153205023"}], "key_name": "tempest-keypair-856679363", "user_data": "}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:07.930365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] validate_networks() for [('d1afac54-5c6c-4b09-a9a4-d3257ac1482d', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:22:08.726147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:22:08.726720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:22:08.727305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:22:08.727763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:22:08.728218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:22:08.740302 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:08.740897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:08.741333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:08.742423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:08.743085 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:08.743751 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:08.764695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:22:08.770212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Getting quotas for user ad400ce73b644938aef19e2da731c4dc and project 4a8966ff4bda461aa40251ac9740d172. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:22:08.784778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:22:08.787319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:22:08.849060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-245600c9-f668-46f9-8952-97c589a3d468 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.064668 Sep 06 20:22:08.850489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 464/890] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:22:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 20:22:08.872898 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-88929818-025c-4288-897f-1b8f3dac233b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:08.874069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-88929818-025c-4288-897f-1b8f3dac233b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:08.879254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:08.973849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-88929818-025c-4288-897f-1b8f3dac233b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:08.982988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-88929818-025c-4288-897f-1b8f3dac233b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1240 microversion: 2.1 time: 0.119529 Sep 06 20:22:08.983673 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 427/891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:08 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:09.146948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:09.149881 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:09.157985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:09.158506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:09.158936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:09.160004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:09.160582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:09.161019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:09.269848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-df25e8c2-d1b8-4132-a8e6-9537497f9ed5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/action" status: 202 len: 0 microversion: 2.1 time: 0.127021 Sep 06 20:22:09.270939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 465/892] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:22:09 2022] POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:22:09.302142 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:09.303596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:09.319133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:09.320506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:09.321425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:09.322637 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:09.323848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:09.324508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:09.799262 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:09.809403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-604133b7-68a5-4625-9da7-89e8c4a4f4e8 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1750 microversion: 2.1 time: 0.529896 Sep 06 20:22:09.810140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 428/893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:09 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1750 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:10.012394 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:10.013114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:10.021191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:10.021719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:10.022156 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:10.022879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:10.023335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:10.023761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:10.100257 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:10.110505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ec95aae3-797c-48ec-b5d6-d8cbf9c2972a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1244 microversion: 2.1 time: 0.103233 Sep 06 20:22:10.111095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 466/894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:10 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:10.839645 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:10.840639 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:10.852193 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:10.853061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:10.853870 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:10.855635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:10.856438 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:10.857191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:11.079248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:11.089382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f15d65d6-557e-46a0-94ca-29ad545cd4df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1750 microversion: 2.1 time: 0.256969 Sep 06 20:22:11.090307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 429/895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:10 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:11.151161 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:11.152818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:11.165516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:11.166391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:11.167720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:11.169095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:11.169959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:11.170951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:11.289561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:11.298778 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6d6b0471-0d32-43f1-a88c-4e1888d8e311 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1244 microversion: 2.1 time: 0.155178 Sep 06 20:22:11.302173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 467/896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:11 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1244 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:12.130257 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:12.131167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:12.146542 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:12.147110 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:12.147582 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:12.148999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:12.150619 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:12.152762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:12.339928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:12.340796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:12.348446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:12.348998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:12.349688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:12.350661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:12.351135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:12.351588 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:12.387514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:12.397731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-967c786a-4717-4b34-88ef-d5517f8a3215 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1750 microversion: 2.1 time: 0.271483 Sep 06 20:22:12.398346 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 430/897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:12 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1750 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:12.442263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:12.451535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f8fcc658-1d7b-4a9b-a556-4a0a2a664039 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1292 microversion: 2.1 time: 0.117471 Sep 06 20:22:12.452134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 468/898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:12 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:13.424390 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:13.425118 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:13.433461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:13.434042 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:13.434508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:13.435338 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:13.435919 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:13.436359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:13.481590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:13.482789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:13.493246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:13.494214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:13.495514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:13.496799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:13.497663 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:13.498435 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:13.605711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:13.620684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c41ee609-c50c-47c3-9859-d5b161971ee9 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1292 microversion: 2.1 time: 0.146122 Sep 06 20:22:13.621863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 469/899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:13 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1292 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:13.661148 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:13.676954 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-89305ef1-e55d-4feb-872c-d7cf01ab2e08 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1750 microversion: 2.1 time: 0.256178 Sep 06 20:22:13.677956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 431/900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:13 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1750 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:14.669878 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:14.670713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:14.677980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:14.678584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:14.679255 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:14.679992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:14.680475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:14.680882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:14.716733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:14.717682 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:14.730201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:14.731293 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:14.732088 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:14.733341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:14.734219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:14.735080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:14.770917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:14.781740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-681b0f41-a06c-4187-85bd-a1bcbfb49417 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1292 microversion: 2.1 time: 0.116619 Sep 06 20:22:14.782888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 470/901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:14 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:14.961797 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:14.978854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3e0d8304-e271-46c8-b546-a9ebbe289e6b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1750 microversion: 2.1 time: 0.265814 Sep 06 20:22:14.980026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 432/902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:14 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1750 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:15.392302 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:15.393258 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:15.407263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:15.408435 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:15.409545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:15.411411 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:15.412549 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:15.413794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:15.471735 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5cd18f52-3203-4c7c-9eb9-fa72c8b1ed3d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/ips" status: 200 len: 151 microversion: 2.20 time: 0.098563 Sep 06 20:22:15.473700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 471/903] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Sep 6 20:22:15 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/ips => generated 151 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:22:15.818891 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:15.820766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:15.883264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:15.884236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:15.885078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:15.886514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:15.887423 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:15.888738 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:16.018861 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:16.026169 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:16.027508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:16.036044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bf3c3128-e442-4c6d-8928-69e9ad3f6f24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1298 microversion: 2.1 time: 0.228470 Sep 06 20:22:16.042916 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 433/904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:15 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1298 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:16.050187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:16.051597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:16.053996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:16.054965 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:16.055570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:16.056086 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:16.276167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:16.288506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-093e4e7d-d8ee-4261-a301-5aa794741f42 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.272613 Sep 06 20:22:16.294350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 472/905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:16 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:17.074343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:17.075464 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:17.094423 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:17.095380 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:17.096808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:17.098821 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:17.100321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:17.101522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:17.338183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:17.339571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:17.347127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:17.347712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:17.348229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:17.349061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:17.349669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:17.350206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:17.362927 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:17.377591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3e857981-9c63-4c26-b3ff-a3fbc0df9a2b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.308666 Sep 06 20:22:17.379358 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 434/906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:17 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:17.539469 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-cbd254b6-7ca9-4410-b8de-fc3aacfc337a req-4e32f361-0ef0-40f3-b3fe-c8b893acc80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04fc08f-4410-47c3-9d79-63795cc3c756", "tag": "a3fcd08d-b886-43f9-8ff6-119e4c3e0333"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:17.564325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-cbd254b6-7ca9-4410-b8de-fc3aacfc337a req-4e32f361-0ef0-40f3-b3fe-c8b893acc80b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:17.565153 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-cbd254b6-7ca9-4410-b8de-fc3aacfc337a req-4e32f361-0ef0-40f3-b3fe-c8b893acc80b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:17.567221 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-cbd254b6-7ca9-4410-b8de-fc3aacfc337a req-4e32f361-0ef0-40f3-b3fe-c8b893acc80b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:17.593451 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-cbd254b6-7ca9-4410-b8de-fc3aacfc337a req-4e32f361-0ef0-40f3-b3fe-c8b893acc80b service nova] Creating event network-changed:a3fcd08d-b886-43f9-8ff6-119e4c3e0333 for instance f04fc08f-4410-47c3-9d79-63795cc3c756 on hv-cinder-84773 Sep 06 20:22:17.619987 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-cbd254b6-7ca9-4410-b8de-fc3aacfc337a req-4e32f361-0ef0-40f3-b3fe-c8b893acc80b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088082 Sep 06 20:22:17.621538 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 435/907] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:17.658235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:17.672943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-231d921b-c52a-4b92-aa90-e3b95031229b tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.339527 Sep 06 20:22:17.673888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 473/908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:17 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:17.746462 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:17.747425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:17.755583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:17.756484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:17.757211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:17.758439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:17.759107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:17.759899 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:17.801923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lazy-loading 'flavor' on Instance uuid a53ac635-8d07-41f0-97d5-f0e81e70b51b {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:22:18.078700 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9a47322e-247f-48db-9fa9-7cc147183703 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/action" status: 202 len: 0 microversion: 2.20 time: 0.342915 Sep 06 20:22:18.080101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 436/909] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 20:22:17 2022] POST /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:22:18.094309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:18.095714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:18.106237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:18.107147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:18.108134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:18.109731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:18.110766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:18.112051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:18.392055 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:18.406423 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:18.406959 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:18.407334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:18.410421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:18.412617 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ef647228-6e95-40b3-a6a0-42006b73cc61 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.327121 Sep 06 20:22:18.413709 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 474/910] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:18 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:18.414671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:18.415279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:18.415715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:18.417071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:18.417451 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:18.417907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:18.589132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:18.598104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4ea3f07a-cf4e-4fbe-bc35-8ce03af66555 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.197015 Sep 06 20:22:18.598942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 437/911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:18 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:18.706644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:18.707329 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:18.714392 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:18.714992 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:18.715471 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:18.716348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:18.716915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:18.717439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:18.754090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:18.779019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=6 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:18.908725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:18.925838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1d254cd0-d57e-4bc0-b649-d15f8f981407 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.223422 Sep 06 20:22:18.926871 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 475/912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:18 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:19.450505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:19.451230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:19.453959 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=6 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:19.462702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:19.463485 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:19.464132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:19.465052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:19.465665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:19.466212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:19.653535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:19.656026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:19.669515 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:19.670591 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:19.671727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:19.673842 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:19.679040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:19.679040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:19.828580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:19.843956 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:19.845603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:19.848009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-cb3c9980-dc3b-4346-b3d9-64bfca196749 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.402279 Sep 06 20:22:19.849628 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 438/913] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:19 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:19.888162 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:19.897415 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b07ed17f-97ff-4c54-ab59-99b3dc9d061c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.267756 Sep 06 20:22:19.898124 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 476/914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:19 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:19.958447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:19.959541 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:19.970735 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:19.971587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:19.972367 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:19.973579 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:19.974428 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:19.975219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:20.175397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:20.186315 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-86129cb0-faaa-43f2-80e2-416c13ed04d9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.235326 Sep 06 20:22:20.186916 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 439/915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:19 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:20.893145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:20.893950 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:20.901865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:20.902414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:20.903159 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:20.904331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:20.904800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:20.905275 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:20.928192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:20.929424 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:20.941850 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:20.942695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:20.943495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:20.944743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:20.945555 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:20.946358 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:20.976759 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:21.108846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:21.125849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:21.129108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:21.131385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a57e2bf2-e121-4f81-8a62-eb35ff355de2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.242823 Sep 06 20:22:21.138339 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 477/916] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:20 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:21.149479 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:21.166012 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3fbb389a-d640-4ca9-8ad9-159fcd3431ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.245209 Sep 06 20:22:21.166802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 440/917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:20 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:21.212131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:21.212814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:21.222297 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:21.223169 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:21.224121 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:21.225263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:21.226134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:21.226907 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:21.269571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:21.442442 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:21.457786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e84372e0-16ee-432e-8a32-4371cee48044 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.250251 Sep 06 20:22:21.458817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 478/918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:21 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:22.166999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:22.168123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:22.180567 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:22.181398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:22.182278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:22.183594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:22.184393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:22.185137 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:22.196292 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:22.197952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:22.210089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:22.210905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:22.211653 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:22.212956 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:22.213894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:22.214590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:22.407077 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:22.416440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bdf84264-7b86-414c-a7a0-2b6e4d173a65 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.228056 Sep 06 20:22:22.417223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 479/919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:22 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:22.424014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:22.440932 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:22.443877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:22.446125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d17e1254-a726-446d-9c13-15b79419e877 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.285062 Sep 06 20:22:22.447146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 441/920] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:22 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:22.488396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:22.489514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:22.503256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:22.503256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:22.506170 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:22.507557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:22.508790 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:22.510105 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:22.804196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:22.830629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4e406c01-68c1-4a91-a940-8299f8537bdd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.350244 Sep 06 20:22:22.831991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 480/921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:22 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:23.447331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:23.448476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:23.460450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:23.461307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:23.462114 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:23.463437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:23.464565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:23.464981 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:23.490719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:23.491732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:23.502712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:23.503559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:23.504150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:23.505034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:23.505692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:23.506422 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:23.706761 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:23.721990 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2340c1f0-47a4-4a08-856d-51aa56ae5dfb tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.280970 Sep 06 20:22:23.723923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 442/922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:23 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:23.745368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:23.761973 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:23.765114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:23.767385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-935c0d9d-fe75-4444-90d1-30e0266d0da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.283678 Sep 06 20:22:23.768429 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 481/923] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:23 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:23.875900 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:23.877074 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:23.888139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:23.889014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:23.889802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:23.891175 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:23.892002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:23.892775 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.147393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:24.158454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b521f175-1c3c-4384-bb4d-726bd619c682 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.290667 Sep 06 20:22:24.159290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 443/924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:23 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:24.169336 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:24.170069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:24.178777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.179417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.179993 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.181064 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.181512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.182740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.209800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lazy-loading 'flavor' on Instance uuid 85d46c6a-bba3-4e7e-ab96-f22796eee28e {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:22:24.303353 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7e5e11bd-d5fc-45f5-b00f-7cbbe63d0d32 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "POST /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e/action" status: 202 len: 0 microversion: 2.1 time: 0.138032 Sep 06 20:22:24.304318 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 482/925] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:22:24 2022] POST /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:22:24.313183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:24.313928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:24.320782 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.321585 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.322079 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.323518 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.324295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.324732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.549564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:24.559096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-01081abd-ad5c-40d8-8bc9-59057abd9b1c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.250102 Sep 06 20:22:24.559965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 444/926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:24 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:24.764502 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:24.768262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:24.772552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-d89a8bf6-9673-42c1-9ce1-c1db0e3e7840 req-426bb5d1-2dcd-4926-9c1e-5865b4ef0dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04fc08f-4410-47c3-9d79-63795cc3c756", "name": "network-vif-plugged", "status": "completed", "tag": "a3fcd08d-b886-43f9-8ff6-119e4c3e0333"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:24.780630 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.781530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.782682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.783920 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.784685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.785901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.797144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d89a8bf6-9673-42c1-9ce1-c1db0e3e7840 req-426bb5d1-2dcd-4926-9c1e-5865b4ef0dbe service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.797144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d89a8bf6-9673-42c1-9ce1-c1db0e3e7840 req-426bb5d1-2dcd-4926-9c1e-5865b4ef0dbe service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.797144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-d89a8bf6-9673-42c1-9ce1-c1db0e3e7840 req-426bb5d1-2dcd-4926-9c1e-5865b4ef0dbe service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.821548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-d89a8bf6-9673-42c1-9ce1-c1db0e3e7840 req-426bb5d1-2dcd-4926-9c1e-5865b4ef0dbe service nova] Creating event network-vif-plugged:a3fcd08d-b886-43f9-8ff6-119e4c3e0333 for instance f04fc08f-4410-47c3-9d79-63795cc3c756 on hv-cinder-84773 Sep 06 20:22:24.832084 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-d89a8bf6-9673-42c1-9ce1-c1db0e3e7840 req-426bb5d1-2dcd-4926-9c1e-5865b4ef0dbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066495 Sep 06 20:22:24.834163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 445/927] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:24.845484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:24.846803 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:24.857364 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.858640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.859615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:24.860835 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:24.861811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:24.862167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:25.050914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:25.062879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c15e25e8-f1b4-40da-bc81-5909bb8af20f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.304874 Sep 06 20:22:25.063944 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 483/928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:24 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:25.108782 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:25.118903 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:25.120849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:25.125151 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3686fe66-6f50-4867-a99d-9664090a212a tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.288666 Sep 06 20:22:25.125922 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 446/929] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:24 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:25.188409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:25.189632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:25.199133 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:25.199896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:25.200566 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:25.201775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:25.202677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:25.202983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:25.421902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:25.433102 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7af623aa-e9b8-4f04-b31b-1015e313beb9 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.252203 Sep 06 20:22:25.433726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 484/930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:25 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:25.602125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:25.602988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:25.609798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:25.610293 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:25.610727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:25.611454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:25.611900 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:25.612321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:25.790333 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:25.809246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-478e5976-130d-4700-92c2-9b45c50850d3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.204798 Sep 06 20:22:25.809246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 447/931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:25 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:26.099123 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:26.099906 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:26.107894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.108448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.108952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:26.109870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.110382 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.110848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:26.168438 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:26.169233 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:26.177656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.178496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.179066 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:26.180013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.180628 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.181303 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:26.297825 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:26.307104 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-120214dc-5e43-4168-bdfb-c956d149f251 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1366 microversion: 2.1 time: 0.211523 Sep 06 20:22:26.307812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 485/932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:26 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:26.409110 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:26.425957 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:26.428792 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:26.431014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8b3c9182-a10e-43a0-8a9c-4b39d93759c8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.266927 Sep 06 20:22:26.432587 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 448/933] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:26 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:26.460659 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:26.461718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:26.464965 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:26.475242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.476081 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.476624 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:26.477995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.479352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.480067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:26.717115 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:26.726693 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-61322c0c-13d6-4713-894b-cebd6ed422a4 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.272737 Sep 06 20:22:26.727160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 486/934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:26 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:26.827629 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:26.828325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:26.835969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.836467 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.836908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:26.838177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:26.838706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:26.839350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.031094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:27.040515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d5abef12-d85d-4f02-856c-27f58d477da2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.218369 Sep 06 20:22:27.041751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 449/935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:26 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:27.333482 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:27.334193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:27.341525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.342030 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.342475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.343224 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.343701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.344140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.462632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:27.463274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:27.474311 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.475380 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.476180 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.477225 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.479916 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.480828 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.552573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:27.567929 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-908c69a9-f2b5-434d-a128-ec192e503e77 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1556 microversion: 2.1 time: 0.238673 Sep 06 20:22:27.569018 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 487/936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:27 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:27.610760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:27.611980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:27.623395 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.624556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.625858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.627430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.628816 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.630433 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.686171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:27.696453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:27.698476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:27.702867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b530805a-523d-43e2-be1e-4b8b54f6120e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.246977 Sep 06 20:22:27.704165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 450/937] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:27 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:27.755508 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-31b9c24b-c891-438a-8c08-dba4bfc41cde tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153470 Sep 06 20:22:27.756699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 488/938] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 6 20:22:27 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:27.757065 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:27.758017 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:27.768802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.769715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.770484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:27.771680 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:27.772505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:27.773511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:28.008432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:28.020960 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c4d2f051-f8ef-402c-a540-802473cf3a06 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1755 microversion: 2.1 time: 0.271488 Sep 06 20:22:28.022013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 451/939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:27 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1755 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:28.088370 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:28.090426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:28.110939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:28.111970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:28.112939 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:28.114587 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:28.115665 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:28.116625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:28.670074 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:28.682449 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5e21bb77-c500-4aad-8917-c59243d88973 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.603762 Sep 06 20:22:28.699090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 489/940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:28 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:28.747561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:28.748786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:28.761169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:28.762603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:28.764508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:28.766131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:28.767001 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:28.767790 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:29.004758 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:29.015966 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:29.017492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:29.018999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-93d948ea-f872-4fad-801b-6f11a1933e1b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.276490 Sep 06 20:22:29.020087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 452/941] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:28 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:29.048274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:29.048888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:29.056702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:29.057204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:29.057809 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:29.058544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:29.059004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:29.059600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:29.378187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:29.390775 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e8a2c061-49a4-47f8-b6e5-27000cfc65bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1758 microversion: 2.1 time: 0.346644 Sep 06 20:22:29.391664 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 490/942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:29 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1758 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:29.710327 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-6c51d998-a7c6-41cd-88d8-a9e8c94c268f req-7d774e8e-b52e-4191-a33b-dab43433a443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04fc08f-4410-47c3-9d79-63795cc3c756", "tag": "a3fcd08d-b886-43f9-8ff6-119e4c3e0333"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:29.711222 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:29.713128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:29.725378 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:29.726646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:29.727877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:29.730238 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:29.731351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:29.732523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:29.741061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-6c51d998-a7c6-41cd-88d8-a9e8c94c268f req-7d774e8e-b52e-4191-a33b-dab43433a443 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:29.742038 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-6c51d998-a7c6-41cd-88d8-a9e8c94c268f req-7d774e8e-b52e-4191-a33b-dab43433a443 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:29.742920 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-6c51d998-a7c6-41cd-88d8-a9e8c94c268f req-7d774e8e-b52e-4191-a33b-dab43433a443 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:29.767574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-6c51d998-a7c6-41cd-88d8-a9e8c94c268f req-7d774e8e-b52e-4191-a33b-dab43433a443 service nova] Creating event network-changed:a3fcd08d-b886-43f9-8ff6-119e4c3e0333 for instance f04fc08f-4410-47c3-9d79-63795cc3c756 on hv-cinder-84773 Sep 06 20:22:29.776182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-6c51d998-a7c6-41cd-88d8-a9e8c94c268f req-7d774e8e-b52e-4191-a33b-dab43433a443 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074941 Sep 06 20:22:29.779223 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 453/943] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:29.961954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:29.978205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b9200934-2eac-4eac-96ad-91ed58b73136 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.273717 Sep 06 20:22:29.979995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 491/944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:29 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:30.052886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:30.054260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:30.067242 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:30.069111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:30.070666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:30.072947 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:30.074304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:30.075703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:30.341999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:30.361972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:30.366861 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:30.369648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6b7ae62d-8325-40d3-92ca-c96c284aa60b tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.325925 Sep 06 20:22:30.371478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 454/945] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:30 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:31.024352 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:31.025839 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:31.037853 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:31.038635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:31.039357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:31.041184 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:31.044223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:31.044986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:31.289865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:31.305063 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1671bee5-e697-41ec-8b16-69c97d3865dd tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.288319 Sep 06 20:22:31.306712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 492/946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:31 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:31.401970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:31.403195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:31.413853 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:31.414685 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:31.415562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:31.417062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:31.418020 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:31.418747 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:31.631672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:31.642678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:31.645547 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:31.647445 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ed6a8713-6685-4a54-93a4-fd9beb868744 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.254122 Sep 06 20:22:31.648331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 455/947] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:31 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:32.345903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:32.346852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:32.359762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:32.360648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:32.361356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:32.362629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:32.363462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:32.364229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:32.394132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:32.539641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:32.554782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-40187f58-b09a-4cb9-b0e5-19b7ced275de tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.212762 Sep 06 20:22:32.556544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 493/948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:32 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:32.694665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:32.695598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:32.704563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:32.705216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:32.705838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:32.706804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:32.707788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:32.708618 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:32.903626 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:32.913911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:32.916675 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:32.918784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-47abae4d-dfe3-4c86-83ff-f80d0e693789 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.229916 Sep 06 20:22:32.919384 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 456/949] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:32 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:33.594517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:33.595786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:33.604415 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:33.605012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:33.605584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:33.606613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:33.607242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:33.607770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:33.811451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:33.827383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f7bfacfe-35a4-425b-b82e-4b926e9dbc51 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.236286 Sep 06 20:22:33.829941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 494/950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:33 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:33.950246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:33.951539 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:33.962964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:33.963812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:33.964565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:33.965819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:33.966631 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:33.967400 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:34.156020 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:34.167014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:34.168626 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:34.170143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b505356f-e3b8-42f0-b44b-22d1b790f073 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.227990 Sep 06 20:22:34.170888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 457/951] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:33 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:34.575400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:34.575782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:34.584631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:34.585423 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:34.585960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:34.586486 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:34.586946 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:34.588164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:34.621789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a946c2c0-4089-4c37-9a53-9059843f81a2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/ips" status: 200 len: 146 microversion: 2.1 time: 0.050051 Sep 06 20:22:34.622919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 495/952] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:22:34 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:34.859010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:34.859685 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:34.870595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:34.871536 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:34.872245 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:34.873530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:34.874581 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:34.875451 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:34.925979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:35.200922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:35.201856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:35.205005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:35.209196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:35.209819 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:35.210546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:35.211570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:35.212611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:35.213351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:35.216806 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c115f48e-a861-4974-9028-f233ab6876a7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.364311 Sep 06 20:22:35.217701 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 458/953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:34 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:35.402186 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:35.412117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:35.413791 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:35.415095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c1f5e11f-4d44-44ca-94e5-f6b022ee126e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.219500 Sep 06 20:22:35.415971 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 496/954] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:35 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:36.100719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2196038a-1c29-45ae-9c5c-1d8d7886bf58"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:36.105030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:36.135422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:36.135422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:36.135422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:36.135422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:36.136068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:36.136068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:36.251455 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:36.252652 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:36.265917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:36.267106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:36.267965 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:36.269096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:36.270032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:36.270911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:36.462890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:36.471186 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-55b16f9c-e799-41fa-bf7a-3d1d0e6775a3 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.226136 Sep 06 20:22:36.471856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 497/955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:36 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:36.476663 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:36.477270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:36.485634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:36.486209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:36.486680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:36.487493 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:36.487953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:36.488388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:36.913982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:36.924568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:36.926293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:36.929042 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-15da5e23-0d86-415b-9a64-17f137946eb0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.456240 Sep 06 20:22:36.929704 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 498/956] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:36 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:37.133216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f153a504-22fe-49a9-b14c-a53a12b5dd4d tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.039193 Sep 06 20:22:37.134463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 459/957] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:22:36 2022] POST /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:22:37.501136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:37.503086 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:37.514252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:37.515107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:37.515827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:37.517111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:37.517951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:37.518638 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:37.701271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:37.711717 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-88281cd9-4d7c-4949-8cdf-17ab9238d6b6 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.218288 Sep 06 20:22:37.712333 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 499/958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:37 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:37.965696 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:37.966462 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:37.980892 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:37.981805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:37.982600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:37.983886 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:37.984766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:37.989410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:38.261529 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:38.278852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:38.283917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:38.287023 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1198a801-21a8-4193-a877-8f7fc7c5d122 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.328152 Sep 06 20:22:38.288295 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 460/959] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:37 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:38.741087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:38.742134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:38.755951 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:38.756657 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:38.757109 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:38.757904 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:38.758379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:38.759406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:38.921564 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:38.930438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6ad9eac3-bf3b-43b0-be07-5a0860f9be57 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1567 microversion: 2.1 time: 0.197027 Sep 06 20:22:38.931573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 500/960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:38 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:38.957924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:38.958525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:38.961073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=70 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:38.969268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:38.969802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:38.970442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:38.971094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:38.971782 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:38.972555 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:39.175504 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120951) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 20:22:39.265507 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b12d55ae-9722-432a-9a94-c1d568df6e0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "POST /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e/action" status: 202 len: 0 microversion: 2.1 time: 0.311672 Sep 06 20:22:39.266556 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 461/961] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:22:38 2022] POST /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:22:39.277551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:39.278678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:39.287558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:39.288202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:39.288594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:39.289416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:39.290652 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:39.291145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:39.333331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:39.334004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:39.341490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:39.342009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:39.342619 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:39.343505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:39.344224 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:39.344841 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:39.560149 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:39.571667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8ed6d6b7-6a34-4ca5-8614-ed318eaae8ff tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1515 microversion: 2.1 time: 0.299698 Sep 06 20:22:39.572295 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 501/962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:39 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:39.613236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:39.624149 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:39.626068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:39.627666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-efeef000-865b-45e1-9361-fb1e51481bfd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1743 microversion: 2.20 time: 0.298554 Sep 06 20:22:39.628439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 462/963] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:39 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1743 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:40.599027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:40.600027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:40.609841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:40.610518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:40.611086 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:40.611999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:40.612664 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:40.613214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:40.671263 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:40.672285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:40.689869 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:40.691165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:40.693192 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:40.694936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:40.696895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:40.698951 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:40.878682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:40.898773 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-898574f6-8850-4223-af9c-1c9bb73107fb tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1517 microversion: 2.1 time: 0.304262 Sep 06 20:22:40.900408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 502/964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:40 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:40.911616 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-3c551af8-bc53-4dba-8f60-229b86d9b0aa req-5e883b05-a35b-4d21-88c9-11212e722d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d46c6a-bba3-4e7e-ab96-f22796eee28e", "name": "network-vif-unplugged", "status": "completed", "tag": "58da1786-9578-4fdc-816f-0dacca3e7184"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:40.942461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3c551af8-bc53-4dba-8f60-229b86d9b0aa req-5e883b05-a35b-4d21-88c9-11212e722d96 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:40.943396 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3c551af8-bc53-4dba-8f60-229b86d9b0aa req-5e883b05-a35b-4d21-88c9-11212e722d96 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:40.944374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3c551af8-bc53-4dba-8f60-229b86d9b0aa req-5e883b05-a35b-4d21-88c9-11212e722d96 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:40.971054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.compute.server_external_events [req-3c551af8-bc53-4dba-8f60-229b86d9b0aa req-5e883b05-a35b-4d21-88c9-11212e722d96 service nova] Unable to find a host for instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e. Dropping event network-vif-unplugged {{(pid=120952) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 20:22:40.973357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-3c551af8-bc53-4dba-8f60-229b86d9b0aa req-5e883b05-a35b-4d21-88c9-11212e722d96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070808 Sep 06 20:22:40.974681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 503/965] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 20:22:40.976795 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:40.987154 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:40.988640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:40.990217 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-dc7f8b92-07ed-4dd3-8106-d097d4d7dd17 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1743 microversion: 2.20 time: 0.325344 Sep 06 20:22:40.991018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 463/966] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:40 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1743 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:41.943475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:41.944443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:41.954882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:41.955947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:41.956777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:41.958035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:41.959118 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:41.960199 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:42.025129 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:42.027014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:42.038596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:42.039438 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:42.040255 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:42.041451 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:42.042274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:42.043042 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:42.184233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:42.201227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-291e0a1c-a048-4398-8120-8b2b95ece4c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1517 microversion: 2.1 time: 0.263629 Sep 06 20:22:42.203230 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 504/967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:41 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:42.300512 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:42.312055 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:42.313754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:42.315232 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-14a4a460-2ff9-44e8-8e62-6e40b46400ce tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.298292 Sep 06 20:22:42.315859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 464/968] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:42 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:43.239658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:43.241014 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:43.249541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:43.250540 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:43.251572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:43.253153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:43.254116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:43.254826 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:43.347687 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:43.350221 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:43.374422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:43.375271 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:43.376043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:43.377281 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:43.383335 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:43.384246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:43.522967 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:43.539202 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fa1abd81-6c15-4b72-93fe-9c645d0e1614 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1517 microversion: 2.1 time: 0.306594 Sep 06 20:22:43.541785 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 505/969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:43 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:43.700747 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:43.719712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:43.722950 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:43.725200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-eaf5ab6e-122c-40c5-9691-d791797d247e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.383041 Sep 06 20:22:43.746132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 465/970] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:43 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:44.571542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:44.572641 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:44.598808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:44.612262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:44.615346 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:44.617293 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:44.618509 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:44.619947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:44.768623 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:44.769492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:44.788852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:44.791178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:44.795235 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:44.796517 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:44.799659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:44.800736 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:45.069739 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:45.093151 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-84d451e6-d4ee-4454-824b-1a8218faf5e2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1517 microversion: 2.1 time: 0.528431 Sep 06 20:22:45.095518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 506/971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:44 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1517 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:45.106744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:45.113390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:45.126103 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:45.126999 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:45.127792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:45.129102 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:45.130921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:45.131711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:45.217072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7d8690d7-b657-415f-b5d3-735bed318e0b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120117 Sep 06 20:22:45.218153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 507/972] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:22:45 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:45.238701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:45.240357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:45.258135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:45.260473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:45.261572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:45.263193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:45.264305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:45.265359 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:45.348388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6528efd6-f2db-4af2-9cca-a3bee56b9558 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/2196038a-1c29-45ae-9c5c-1d8d7886bf58" status: 200 len: 194 microversion: 2.1 time: 0.116920 Sep 06 20:22:45.354001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 508/973] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Sep 6 20:22:45 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/2196038a-1c29-45ae-9c5c-1d8d7886bf58 => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:45.392127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-3ca2a3c0-f9ed-4699-a79b-81120bc46851 req-3508d669-832e-4beb-bd06-66a3bb208649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ac635-8d07-41f0-97d5-f0e81e70b51b", "name": "network-vif-plugged", "status": "completed", "tag": "26463c3c-fa68-45c1-9baa-cb0cf6ff34ec"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:45.422868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3ca2a3c0-f9ed-4699-a79b-81120bc46851 req-3508d669-832e-4beb-bd06-66a3bb208649 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:45.423400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3ca2a3c0-f9ed-4699-a79b-81120bc46851 req-3508d669-832e-4beb-bd06-66a3bb208649 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:45.423838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-3ca2a3c0-f9ed-4699-a79b-81120bc46851 req-3508d669-832e-4beb-bd06-66a3bb208649 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:45.460955 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-3ca2a3c0-f9ed-4699-a79b-81120bc46851 req-3508d669-832e-4beb-bd06-66a3bb208649 service nova] Creating event network-vif-plugged:26463c3c-fa68-45c1-9baa-cb0cf6ff34ec for instance a53ac635-8d07-41f0-97d5-f0e81e70b51b on hv-cinder-84773 Sep 06 20:22:45.472232 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-3ca2a3c0-f9ed-4699-a79b-81120bc46851 req-3508d669-832e-4beb-bd06-66a3bb208649 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085304 Sep 06 20:22:45.475367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 509/974] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:46.010852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:46.042195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:46.045213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:46.048258 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-938fb5de-7e3b-42a2-8741-fdfb9f4476b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 1.283672 Sep 06 20:22:46.048852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 466/975] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:44 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:46.124616 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:46.126259 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:46.151469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:46.152157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:46.156684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:46.158712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:46.159216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:46.159752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:46.704847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:46.735327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-36829fcb-2229-41a8-8d6d-b5aefb756a0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.616906 Sep 06 20:22:46.737279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 510/976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:46 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:47.093004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:47.095314 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:47.125031 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:47.127512 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:47.128962 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:47.133897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:47.135176 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:47.136303 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:47.344634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4b2764a-f892-431c-9363-8278b2d4d074"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:22:47.353139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:47.376368 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:47.377722 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:47.378898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:47.381006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:47.382312 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:47.383527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:47.554338 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=100 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:47.982155 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:48.014819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:48.018494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:48.025210 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-dfbcefaa-d7d7-4ce9-a6af-e281be89b178 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.942470 Sep 06 20:22:48.038860 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 467/977] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:47 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:48.067750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:48.069509 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:48.083125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:48.084260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:48.085665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:48.087519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:48.088355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:48.089191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:48.114941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-dba72465-da5d-4381-8c86-6613c8d7e631 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "POST /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779505 Sep 06 20:22:48.120520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 511/978] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:22:47 2022] POST /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:48.696376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:48.714657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8cf38d46-68c5-41ef-ac66-38c4000cc383 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.673741 Sep 06 20:22:48.720797 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 468/979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:48 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:49.076633 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:49.078863 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:49.098133 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:49.099088 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:49.100219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:49.102372 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:49.103335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:49.104505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:49.419648 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:49.439955 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:49.442556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:49.449319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-95924826-0741-43ad-b9bb-42e34982b21c tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.379567 Sep 06 20:22:49.475308 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 512/980] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:49 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:49.760971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:49.761637 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:49.779741 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:49.780280 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:49.780730 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:49.781468 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:49.782105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:49.782580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:50.082150 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:50.094686 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9bc7b9f9-425d-4c44-90e2-aa0775bb7e1e tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.338165 Sep 06 20:22:50.095687 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 469/981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:49 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:50.490876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:50.491517 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:50.506373 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:50.506878 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:50.507388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:50.511847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:50.512341 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:50.521237 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:50.819206 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:50.844874 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:50.848062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:50.851448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-290f82c7-a5e8-43e8-b544-3e372482c5c4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.373303 Sep 06 20:22:50.865166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 513/982] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:50 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:51.125472 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:51.126507 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:51.163256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:51.165343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:51.171926 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:51.173312 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:51.174203 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:51.175430 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:51.527510 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:51.551131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-af501269-59ea-495d-960f-a34bd4db055a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.432758 Sep 06 20:22:51.554003 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 470/983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:51 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:51.887846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:51.890374 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:51.923982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:51.924979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:51.926126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:51.928805 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:51.931157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:51.932514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:52.403116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:52.425945 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:52.430633 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:52.433884 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0f32dc0b-7990-4e77-9a98-c2232ff0558e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.552601 Sep 06 20:22:52.451490 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 514/984] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:51 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:22:52.590983 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:52.593294 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:52.607184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:52.614542 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:52.618857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:52.620564 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:52.621477 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:52.622788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:52.996494 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:53.022830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4772266e-f5f9-4873-8289-d8a35fc71ec2 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.432935 Sep 06 20:22:53.024431 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 471/985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:52 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:53.483137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:53.485190 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:53.511384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:53.515010 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:53.517109 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:53.520028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:53.522518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:53.523245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:53.853190 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:53.863467 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:53.865712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:53.868456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3c08ed8e-a6eb-4a8b-988e-d5c5bbbeaa88 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.392555 Sep 06 20:22:53.869375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 515/986] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:53 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:54.056420 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:54.057857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:54.072851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:54.073463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:54.078334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:54.079369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:54.080301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:54.081015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:54.385165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:54.397070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:54.403540 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5e8fd381-ca5c-4f08-94a0-7fef3df97994 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.352054 Sep 06 20:22:54.407425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 472/987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:54 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:54.917314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:54.936473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:54.968483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:54.969569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:54.970669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:54.978553 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:54.982672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:54.984432 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:55.438356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:55.439612 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:55.443351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:55.452633 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:55.454748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:55.457013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5cd4cf73-b163-476c-8eb7-25b5378d4999 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.558493 Sep 06 20:22:55.459194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 516/988] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:54 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:55.476127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:55.486182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:55.487368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:55.495902 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:55.501353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:55.502715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:56.113606 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:56.155339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fe3681a8-49f5-48e3-a3e4-e078d21bf704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.725703 Sep 06 20:22:56.178937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 473/989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:55 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:56.509426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:56.525154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:56.534476 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=62 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:56.555216 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:56.572922 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:56.575829 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:56.577959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:56.579262 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:56.580407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:57.181870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:57.196187 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:57.198631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:57.200263 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-191a51ac-8551-4fa2-b967-8552a686552e tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.699802 Sep 06 20:22:57.208757 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:57.212742 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:57.219384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 517/990] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:56 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:57.254438 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:57.254973 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:57.256405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:57.258998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:57.264946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:57.266085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:57.883127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:57.887427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:57.904160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:57.905848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:57.907173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:57.910061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:57.911397 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:57.912546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:57.978698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1695be3c-247f-4418-b03d-bd3d7a195aec tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.099504 Sep 06 20:22:57.994339 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 518/991] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:22:57 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:22:58.088023 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:58.102613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b0d35d79-6a39-4d6c-b879-d2cc5a58c9c7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.902861 Sep 06 20:22:58.105105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 474/992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:57 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:22:58.139649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:58.140747 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:58.162698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:58.166965 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:58.167696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:58.168984 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:58.171910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:58.173868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:58.238068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:58.239631 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:58.259678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:58.264540 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:58.268415 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:58.269379 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:58.273482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:58.276689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:58.295084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-65f66856-2b1f-4238-85fb-16d6f2f4fd63 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/2196038a-1c29-45ae-9c5c-1d8d7886bf58" status: 200 len: 194 microversion: 2.1 time: 0.161991 Sep 06 20:22:58.305346 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 519/993] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Sep 6 20:22:58 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/2196038a-1c29-45ae-9c5c-1d8d7886bf58 => generated 194 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:22:58.314656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:58.315395 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:58.348004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:58.348646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:58.354012 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:58.356153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:58.356565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:58.357375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:58.671938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lazy-loading 'services' on Instance uuid 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:22:58.697385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:58.735222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:58.744194 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:58.746209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ea98923d-cbcd-46fd-b292-8615d4e31a84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.512650 Sep 06 20:22:58.749213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 475/994] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:58 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:22:58.884069 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c1a91ed8-8612-41d6-a5a2-b7f5aeca7193 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/2196038a-1c29-45ae-9c5c-1d8d7886bf58" status: 202 len: 0 microversion: 2.1 time: 0.575730 Sep 06 20:22:58.886388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 520/995] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:22:58 2022] DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/2196038a-1c29-45ae-9c5c-1d8d7886bf58 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:22:59.161453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:59.162272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:59.179145 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:59.187077 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:59.189146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:59.193562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:59.195505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:59.204697 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:59.822492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:22:59.823728 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:22:59.824490 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:22:59.853134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e5b93fd6-e0f3-4ff8-b651-ccb649042b1f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.690218 Sep 06 20:22:59.873677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 476/996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:22:59 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:22:59.874355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:59.874355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:59.874355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:22:59.874355 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:22:59.876071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:22:59.884896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:00.620150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:00.629989 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:00.631748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:00.633451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bdb8cf4b-3f65-4d0b-af11-760b26feb2fd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.829278 Sep 06 20:23:00.634241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 521/997] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:22:59 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:00.922967 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:00.928365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:00.969338 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:00.973538 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:00.977087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:00.981209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:00.985134 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:00.987745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:01.353793 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:01.354381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:01.379318 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:01.379838 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:01.380306 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:01.381072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:01.381727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:01.382167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:01.518347 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-58432e1b-d5c4-4e31-bfd2-c98fc8869d19 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/d4b2764a-f892-431c-9363-8278b2d4d074" status: 200 len: 194 microversion: 2.1 time: 0.169396 Sep 06 20:23:01.536712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 522/998] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Sep 6 20:23:01 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/d4b2764a-f892-431c-9363-8278b2d4d074 => generated 194 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:23:01.554711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:01.555277 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:01.592208 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:01.592739 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:01.593169 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:01.594402 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:01.595059 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:01.595584 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:01.782976 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:01.810648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3798d2a8-a1dc-40de-b891-3364c959e051 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.904927 Sep 06 20:23:01.818702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 477/999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:00 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:01.826500 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:01.847613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lazy-loading 'services' on Instance uuid 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:23:01.851767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:01.870506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:01.871672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:01.872543 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:01.874743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:01.876725 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:01.878855 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:02.157076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-13f8129b-6fde-4ea6-a511-c4b52fb5d7db tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/d4b2764a-f892-431c-9363-8278b2d4d074" status: 202 len: 0 microversion: 2.1 time: 0.612688 Sep 06 20:23:02.176472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 523/1000] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:23:01 2022] DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments/d4b2764a-f892-431c-9363-8278b2d4d074 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:23:02.564638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:02.581901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:02.583890 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:02.585266 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-94459ae5-a529-4220-b169-e84a858157dd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.765177 Sep 06 20:23:02.586438 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 478/1001] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:01 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:02.860723 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:02.861666 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:02.869894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:02.870405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:02.870856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:02.871616 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:02.872075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:02.881076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:03.234587 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:03.251976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e6bde66c-255d-4680-86cd-26c0a5930079 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.396738 Sep 06 20:23:03.283750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 524/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:02 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:03.635108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:03.635797 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:03.657260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:03.657780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:03.658233 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:03.659095 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:03.659557 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:03.659991 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:04.247470 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:04.273340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:04.282017 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:04.283743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-839b0891-1dc6-4ed1-9d18-05104d99980d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.653250 Sep 06 20:23:04.308727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 479/1003] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:03 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:04.314279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:04.315466 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:04.336800 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:04.337700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:04.339082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:04.340418 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:04.341272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:04.342084 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:04.448643 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-1de72295-d484-47b4-a123-9543466898d6 req-d670e297-59af-4161-aa21-149382b1d17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d46c6a-bba3-4e7e-ab96-f22796eee28e", "name": "network-vif-plugged", "status": "completed", "tag": "58da1786-9578-4fdc-816f-0dacca3e7184"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:04.476577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-1de72295-d484-47b4-a123-9543466898d6 req-d670e297-59af-4161-aa21-149382b1d17e service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:04.477063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-1de72295-d484-47b4-a123-9543466898d6 req-d670e297-59af-4161-aa21-149382b1d17e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:04.486490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-1de72295-d484-47b4-a123-9543466898d6 req-d670e297-59af-4161-aa21-149382b1d17e service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:04.503148 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-1de72295-d484-47b4-a123-9543466898d6 req-d670e297-59af-4161-aa21-149382b1d17e service nova] Creating event network-vif-plugged:58da1786-9578-4fdc-816f-0dacca3e7184 for instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e on hv-cinder-84773 Sep 06 20:23:04.516677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-1de72295-d484-47b4-a123-9543466898d6 req-d670e297-59af-4161-aa21-149382b1d17e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072129 Sep 06 20:23:04.519130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 480/1004] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:04.780852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:04.790518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:04.795900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ed3fd33d-e78e-4b1f-9ea8-b20ab391e988 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.501513 Sep 06 20:23:04.797350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 525/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:04 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:04.807599 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:04.812660 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:04.822658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:04.823578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:04.824347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:04.825590 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:04.826340 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:04.827005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:04.892790 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4336efdd-0660-4ff5-8f55-042bc19281ee tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091708 Sep 06 20:23:04.894148 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 481/1006] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:04 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 20:23:05.126862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:05.130280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:05.148978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.154446 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.155151 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.155915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.156392 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.156824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.236219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c334b836-1577-431b-a5ae-e58f09e41cf7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113658 Sep 06 20:23:05.246934 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 526/1007] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:05 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 20:23:05.312171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:05.313102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:05.325102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.325698 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.326200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.326961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.333209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.333793 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.401413 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:05.402218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:05.433281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.434117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.435129 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.438588 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.439319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.439917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.486330 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:23:05.639139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e9434d4b-50a7-4140-859a-941b55d2ff5c tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 204 len: 0 microversion: 2.1 time: 0.251216 Sep 06 20:23:05.642252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 527/1008] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:05 2022] DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:23:05.658093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:05.659214 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:05.667686 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.668928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.669590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.670613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.671451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.672125 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.805480 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:05.831832 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:05.843690 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:05.845553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fc85d791-0207-4629-bc58-98c666ab7ecc tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.538100 Sep 06 20:23:05.846436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 482/1009] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:05 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:05.865808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:05.868025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:05.883729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.884637 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.885336 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:05.886363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:05.887061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:05.887721 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:06.059786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:06.086044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8ba06459-0a98-42e5-ae7f-174a87e111b2 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1674 microversion: 2.1 time: 0.435419 Sep 06 20:23:06.088197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 528/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:05 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1674 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:06.301151 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:06.313215 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-edab92c7-b94b-4fe1-a057-b8304a989da7 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.465308 Sep 06 20:23:06.314339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 483/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:05 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:06.880982 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:06.882269 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:06.894133 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:06.895289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:06.896280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:06.898327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:06.899619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:06.900549 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:07.137352 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:07.138238 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:07.158889 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:07.159512 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:07.159981 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:07.166666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:07.168909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:07.168909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:07.192588 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:07.210568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:07.214319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:07.217016 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1c56b55d-828e-4910-941a-dd103ce59da2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.344583 Sep 06 20:23:07.230586 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 529/1012] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:06 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:07.372562 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:07.373833 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:07.382606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:07.383337 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:07.384060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:07.385420 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:07.386132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:07.386745 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:07.590191 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:07.600443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b53475aa-df27-4134-8f41-442ef02b7120 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1674 microversion: 2.1 time: 0.468563 Sep 06 20:23:07.601405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 484/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:07 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1674 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:07.621958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:07.633310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0df9afe5-6c9c-4f67-82f1-d9c8242bd549 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1573 microversion: 2.1 time: 0.267038 Sep 06 20:23:07.634112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 530/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:07 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1573 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:08.269405 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:08.271490 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6d8e9002-bf50-4a30-8d97-6e3568a63866 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Action: 'create', calling method: .version_select at 0x7f9c3b8eed30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-556363554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOiL9OyNk0eDDsElUMxMZpdTiONDVhDBa+nr5vxzwVsB/IhD5ZZGqW4UELM7mIJnZQXAwXgPl9X40ZpoFUb8NMgz6wcpaQmwP3A2Rhsn1G/RaHNkD5dWBS0PKwkF20pUw=="}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:08.273568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:08.288646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:08.289841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:08.291000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:08.292995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:08.294048 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:08.294952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:08.297442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-6d8e9002-bf50-4a30-8d97-6e3568a63866 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for project ed4697b9e0a940b284b392b3e93197c7. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:23:08.304965 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-6d8e9002-bf50-4a30-8d97-6e3568a63866 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for user 7f661aa1f00e4c7e916b2498505475dc and project ed4697b9e0a940b284b392b3e93197c7. Resources: {'key_pairs'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:23:08.347212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6d8e9002-bf50-4a30-8d97-6e3568a63866 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.394508 Sep 06 20:23:08.348536 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 485/1015] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 6 20:23:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:08.580720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:08.604431 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:08.607720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:08.609959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ccea5cda-5136-4514-8461-bb8183a17090 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1738 microversion: 2.20 time: 0.349513 Sep 06 20:23:08.610980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 531/1016] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:08 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1738 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:08.647403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:08.647403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:08.661465 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:08.662363 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:08.663746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:08.665148 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:08.666492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:08.667362 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:08.680462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:08.681548 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:08.694941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:08.696544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:08.697708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:08.699348 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:08.700525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:08.702049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:09.043474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:09.063553 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-564b20e9-9afe-4d09-8d94-b9446928f25c tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1560 microversion: 2.1 time: 0.391591 Sep 06 20:23:09.065727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 532/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:08 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1560 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:09.130980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:09.151198 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-14e2f984-804f-4a6e-8f94-e75a7fb83f2b tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1674 microversion: 2.1 time: 0.514493 Sep 06 20:23:09.152105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 486/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:08 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1674 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:09.656194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:09.657406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:09.671073 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:09.673126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:09.674718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:09.676160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:09.677334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:09.678246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:09.973471 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:09.987917 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:09.990075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:09.991582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0bdc971c-b65a-4fbe-973b-9c46b9e81dbe tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1720 microversion: 2.20 time: 0.344699 Sep 06 20:23:09.993834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 533/1019] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:09 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1720 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:10.181655 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:10.185777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:10.195657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:10.210612 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:10.212014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:10.213216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:10.215410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:10.216087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:10.216857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:10.935236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:10.949375 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f57b851f-713f-43c3-853c-8da1e3899908 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1674 microversion: 2.1 time: 0.776528 Sep 06 20:23:10.950526 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 487/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:10 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1674 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:11.024919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:11.027151 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:11.061165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:11.074802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:11.076310 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:11.080516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:11.082067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:11.084792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:11.557117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:11.597304 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:11.603131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:11.608776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b9a80802-e10a-41d7-8d12-73b1fba24e44 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1720 microversion: 2.20 time: 0.592161 Sep 06 20:23:11.612334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 534/1021] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:11 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1720 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:11.898528 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-fa66a16c-096d-43f2-bc5d-55ad13d47f68 req-17eccafd-c35a-40db-9399-0ad2fc58e740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6e2397-bd4a-4d38-8b85-fd89946ed9ef", "name": "network-vif-deleted", "tag": "dc5481fe-dfff-4268-b210-bb8607c0792d"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:11.926271 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-fa66a16c-096d-43f2-bc5d-55ad13d47f68 req-17eccafd-c35a-40db-9399-0ad2fc58e740 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:11.931992 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-fa66a16c-096d-43f2-bc5d-55ad13d47f68 req-17eccafd-c35a-40db-9399-0ad2fc58e740 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:11.934962 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-fa66a16c-096d-43f2-bc5d-55ad13d47f68 req-17eccafd-c35a-40db-9399-0ad2fc58e740 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:11.954355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-fa66a16c-096d-43f2-bc5d-55ad13d47f68 req-17eccafd-c35a-40db-9399-0ad2fc58e740 service nova] Creating event network-vif-deleted:dc5481fe-dfff-4268-b210-bb8607c0792d for instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef on hv-cinder-84773 Sep 06 20:23:11.961739 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-fa66a16c-096d-43f2-bc5d-55ad13d47f68 req-17eccafd-c35a-40db-9399-0ad2fc58e740 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072163 Sep 06 20:23:11.962914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 488/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:12.000113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:12.002235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:12.015903 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:12.017290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:12.018406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:12.020213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:12.021597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:12.023169 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:12.217713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f49ef54a38614cb880577626e65b0e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27f27bdf0ac14f62b682027b05b219ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:12.237317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c9f4c00d-cb60-46c5-82c6-ac432f4338bf tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 200 len: 1607 microversion: 2.1 time: 0.248666 Sep 06 20:23:12.238765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 535/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:11 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 1607 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:12.692141 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:12.694381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:12.719317 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:12.720318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:12.723989 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:12.725775 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:12.729960 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:12.731052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:12.986672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-36989193"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:12.989335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:13.015611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:13.018101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:13.018875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:13.019846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:13.020647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:13.032160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:13.049337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:13.062063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:13.064424 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:13.065990 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-347c1906-6367-4651-a54f-99f2a2f2eea2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1723 microversion: 2.20 time: 0.405348 Sep 06 20:23:13.066733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 489/1024] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:12 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1723 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:13.124405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c07fbb8-8a06-4bc2-a938-a55ba6bf1a97"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:13.131346 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:13.149524 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:13.150043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:13.151173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:13.153355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:13.154143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:13.154984 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:13.498323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.network.security_group_api [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Removing security group c99d5d4c-0dc7-4d4c-82b2-145d23e2cde1 from port 03bf2ca5-99d4-4234-8de2-d6f243ea50d8 Sep 06 20:23:13.683375 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:14.052102 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-458e7897-06e9-4426-a9d1-e42dc7675e48 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.937684 Sep 06 20:23:14.054239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 490/1025] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Sep 6 20:23:13 2022] POST /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-volume_attachments => generated 188 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 20:23:14.062867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:14.063848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:14.074167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.075352 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.076053 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:14.077994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.079101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.080166 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:14.110580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] HTTP exception thrown: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Request method failure captured: Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef HTTP/1.1 Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pRlRTVlLxdqMeviE7q_y_xNZ3p7ejCxymVnpdp13db6bVnnl8v4DXL0c7AFjJAfVyY6NAz4yOtX_vF58wBdUak4I2gdVUyTD9-IWZTSFuhpGhUHb-57iF558zB3SASKK0W1WPWujBY3RSv7UI9kof_cqE-t2IeTx16DEpxo9cKn-U Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:14.114996 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: f49ef54a38614cb880577626e65b0e32 Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:14.118811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '3f6e2397-bd4a-4d38-8b85-fd89946ed9ef'} Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:14.138071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:14.141169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:14.144634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Returning 404 to user: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:14.144634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d1f48463-3a1a-466d-bbc3-a93d2b40f3fe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 404 len: 111 microversion: 2.1 time: 0.063153 Sep 06 20:23:14.144634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 491/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:14 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:14.144634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-4b1d4fec-e714-4c4a-89e6-739133ffcd28 req-4ebaf85a-6fe0-4639-b38d-7b20c981496b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ac635-8d07-41f0-97d5-f0e81e70b51b", "name": "network-vif-unplugged", "status": "completed", "tag": "26463c3c-fa68-45c1-9baa-cb0cf6ff34ec"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:14.168703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4b1d4fec-e714-4c4a-89e6-739133ffcd28 req-4ebaf85a-6fe0-4639-b38d-7b20c981496b service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.169486 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4b1d4fec-e714-4c4a-89e6-739133ffcd28 req-4ebaf85a-6fe0-4639-b38d-7b20c981496b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.169980 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4b1d4fec-e714-4c4a-89e6-739133ffcd28 req-4ebaf85a-6fe0-4639-b38d-7b20c981496b service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:14.207683 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-4b1d4fec-e714-4c4a-89e6-739133ffcd28 req-4ebaf85a-6fe0-4639-b38d-7b20c981496b service nova] Creating event network-vif-unplugged:26463c3c-fa68-45c1-9baa-cb0cf6ff34ec for instance a53ac635-8d07-41f0-97d5-f0e81e70b51b on hv-cinder-84773 Sep 06 20:23:14.217001 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-4b1d4fec-e714-4c4a-89e6-739133ffcd28 req-4ebaf85a-6fe0-4639-b38d-7b20c981496b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092984 Sep 06 20:23:14.217653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 492/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:14.236171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:14.237999 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:14.259609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.261762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.264296 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:14.269357 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.270085 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.270584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:14.307658 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e34e3dc7-a84c-4864-8252-1fb1e24a7a8e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/ips" status: 200 len: 150 microversion: 2.1 time: 0.084463 Sep 06 20:23:14.308976 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 493/1028] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:23:14 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:14.314988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5fcd9205-761a-4d42-8833-e95865d63735 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '.version_select at 0x7f9c3b9163a0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:14.373592 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5fcd9205-761a-4d42-8833-e95865d63735 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410650869" status: 202 len: 0 microversion: 2.1 time: 0.060732 Sep 06 20:23:14.375322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 494/1029] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 6 20:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410650869 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:23:14.525849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:14.526894 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:14.547186 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.548136 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.548957 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:14.550330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.551558 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.552689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:14.924644 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-32c048a1-8464-41aa-8798-ee7930e3a140 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/action" status: 202 len: 0 microversion: 2.1 time: 1.953308 Sep 06 20:23:14.931325 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 536/1030] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 6 20:23:12 2022] POST /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/action => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:23:14.953191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-8f4c3241-0c69-409f-b1e5-0ac3f45d24dc req-76a8f9d8-7db4-4395-97b0-7453bdf26342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefab8aa-8f04-40bf-b79e-8d360f621421", "tag": "03bf2ca5-99d4-4234-8de2-d6f243ea50d8"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:14.984964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-8f4c3241-0c69-409f-b1e5-0ac3f45d24dc req-76a8f9d8-7db4-4395-97b0-7453bdf26342 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:14.986688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-8f4c3241-0c69-409f-b1e5-0ac3f45d24dc req-76a8f9d8-7db4-4395-97b0-7453bdf26342 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:14.990188 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-8f4c3241-0c69-409f-b1e5-0ac3f45d24dc req-76a8f9d8-7db4-4395-97b0-7453bdf26342 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:15.048050 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-8f4c3241-0c69-409f-b1e5-0ac3f45d24dc req-76a8f9d8-7db4-4395-97b0-7453bdf26342 service nova] Creating event network-changed:03bf2ca5-99d4-4234-8de2-d6f243ea50d8 for instance cefab8aa-8f04-40bf-b79e-8d360f621421 on hv-cinder-84773 Sep 06 20:23:15.085139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-8f4c3241-0c69-409f-b1e5-0ac3f45d24dc req-76a8f9d8-7db4-4395-97b0-7453bdf26342 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123914 Sep 06 20:23:15.085139 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 537/1031] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:15.296278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9ae15109-c0e0-4a14-87f0-78514ffaabb6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-volume_attachments/8c07fbb8-8a06-4bc2-a938-a55ba6bf1a97" status: 202 len: 0 microversion: 2.20 time: 0.779484 Sep 06 20:23:15.298397 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 495/1032] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Sep 6 20:23:14 2022] DELETE /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-volume_attachments/8c07fbb8-8a06-4bc2-a938-a55ba6bf1a97 => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 20:23:15.470947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:15.472033 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:15.494093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:15.495783 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:15.496883 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:15.498525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:15.499636 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:15.500614 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:15.617194 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120952) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 20:23:15.811279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-47a395e9-4d5d-4e28-b834-caf8f7043585 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "POST /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/action" status: 202 len: 0 microversion: 2.20 time: 0.348434 Sep 06 20:23:15.813181 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 538/1033] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 6 20:23:15 2022] POST /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:23:15.824455 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:15.825431 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:15.841854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:15.842433 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:15.848028 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:15.849595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:15.849595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:15.849909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:16.214086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:16.238504 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:16.249497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:16.253105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e9f8cca5-7050-45c7-a495-652bad2e414f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1671 microversion: 2.20 time: 0.433081 Sep 06 20:23:16.254923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 496/1034] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:15 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1671 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:16.348631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8197c0d-5578-45db-aee6-8a09ee9e0b9c"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:16.353959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:16.368965 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:16.370546 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:16.373234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:16.376462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:16.379174 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:16.380360 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:17.059830 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:17.129840 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2cb9018c-ff6e-4a4f-b8db-cbe55946e22f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "POST /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.788560 Sep 06 20:23:17.130570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 539/1035] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 6 20:23:16 2022] POST /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:17.305834 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:17.306477 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:17.323655 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:17.324559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:17.325243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:17.326179 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:17.326708 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:17.340115 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:17.623599 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:17.636165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:17.638272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:17.640608 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-eb98d7c3-fd9a-4762-8cc8-7bde7fbee897 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1671 microversion: 2.20 time: 0.340093 Sep 06 20:23:17.641452 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 497/1036] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:17 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1671 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:18.164910 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:18.165859 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:18.169181 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-c8e49a0f-dc19-4806-8d9e-6d3d90567e02 req-a7f18046-09b8-4ec8-9a5c-5c0361a04a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cefab8aa-8f04-40bf-b79e-8d360f621421", "tag": "03bf2ca5-99d4-4234-8de2-d6f243ea50d8"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:18.175330 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:18.176332 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:18.188485 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:18.189769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:18.190544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:18.191223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:18.211410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-c8e49a0f-dc19-4806-8d9e-6d3d90567e02 req-a7f18046-09b8-4ec8-9a5c-5c0361a04a2a service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:18.212818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-c8e49a0f-dc19-4806-8d9e-6d3d90567e02 req-a7f18046-09b8-4ec8-9a5c-5c0361a04a2a service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:18.214018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-c8e49a0f-dc19-4806-8d9e-6d3d90567e02 req-a7f18046-09b8-4ec8-9a5c-5c0361a04a2a service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:18.244759 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-c8e49a0f-dc19-4806-8d9e-6d3d90567e02 req-a7f18046-09b8-4ec8-9a5c-5c0361a04a2a service nova] Creating event network-changed:03bf2ca5-99d4-4234-8de2-d6f243ea50d8 for instance cefab8aa-8f04-40bf-b79e-8d360f621421 on hv-cinder-84773 Sep 06 20:23:18.251909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-c8e49a0f-dc19-4806-8d9e-6d3d90567e02 req-a7f18046-09b8-4ec8-9a5c-5c0361a04a2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092334 Sep 06 20:23:18.252552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 498/1037] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:18.332921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lazy-loading 'services' on Instance uuid cefab8aa-8f04-40bf-b79e-8d360f621421 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:23:18.518060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1c4d86eb-7924-4be6-ade1-22442127f06f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments/c282c92f-7a26-4ebd-8862-3dd9a6564933" status: 202 len: 0 microversion: 2.1 time: 0.358058 Sep 06 20:23:18.519882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 540/1038] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:23:18 2022] DELETE /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments/c282c92f-7a26-4ebd-8862-3dd9a6564933 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:23:18.536852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:18.547193 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:18.556495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=4 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:18.572764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:18.574866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:18.576297 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:18.578024 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:18.579005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:18.580123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:18.662586 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-903820dd-a676-47d1-ae9b-23b5d4528bcd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132984 Sep 06 20:23:18.664495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 499/1039] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:18 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:18.693218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:18.695026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:18.728020 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:18.728953 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:18.729890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:18.730963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:18.731530 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:18.732157 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:19.008845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:19.024670 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:19.028265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:19.030592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-db956355-b69f-4d38-827f-ca2d8bcbd9cd tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.359046 Sep 06 20:23:19.031592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 541/1040] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:18 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:19.485521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:19.486482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:19.495754 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:19.496804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:19.497521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:19.498646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:19.499420 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:19.500268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:19.519847 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] HTTP exception thrown: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Request method failure captured: Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef HTTP/1.1 Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pRlRTVlLxdqMeviE7q_y_xNZ3p7ejCxymVnpdp13db6bVnnl8v4DXL0c7AFjJAfVyY6NAz4yOtX_vF58wBdUak4I2gdVUyTD9-IWZTSFuhpGhUHb-57iF558zB3SASKK0W1WPWujBY3RSv7UI9kof_cqE-t2IeTx16DEpxo9cKn-U Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:19.523052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: f49ef54a38614cb880577626e65b0e32 Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.524506 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '3f6e2397-bd4a-4d38-8b85-fd89946ed9ef'} Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:19.525269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.527030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.530814 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Returning 404 to user: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:19.532594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-19f288e2-605c-4b40-8514-a3c9a0ceb2a7 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 404 len: 111 microversion: 2.1 time: 0.050766 Sep 06 20:23:19.536845 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 500/1041] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:19 2022] DELETE /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 20:23:19.547108 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:19.548259 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:19.576513 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:19.579021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:19.580254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:19.582113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:19.583066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:19.583890 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:19.627833 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] HTTP exception thrown: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Request method failure captured: Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef HTTP/1.1 Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pRlRTVlLxdqMeviE7q_y_xNZ3p7ejCxymVnpdp13db6bVnnl8v4DXL0c7AFjJAfVyY6NAz4yOtX_vF58wBdUak4I2gdVUyTD9-IWZTSFuhpGhUHb-57iF558zB3SASKK0W1WPWujBY3RSv7UI9kof_cqE-t2IeTx16DEpxo9cKn-U Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:19.630900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: f49ef54a38614cb880577626e65b0e32 Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.633279 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '3f6e2397-bd4a-4d38-8b85-fd89946ed9ef'} Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:19.634369 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. Sep 06 20:23:19.635980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:19.640245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Returning 404 to user: Instance 3f6e2397-bd4a-4d38-8b85-fd89946ed9ef could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:19.642272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-913ec2b0-ce1c-4dd8-909f-f68db1ada6c4 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef" status: 404 len: 111 microversion: 2.1 time: 0.103372 Sep 06 20:23:19.643958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 542/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:19 2022] GET /compute/v2.1/servers/3f6e2397-bd4a-4d38-8b85-fd89946ed9ef => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:19.687091 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:19.692422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:19.707840 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:19.708517 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:19.709454 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:19.711103 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:19.711985 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:19.712598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:19.801409 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f0530082-9266-4064-b3e8-eb02970eb0df tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118438 Sep 06 20:23:19.804620 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 501/1043] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:19 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:23:20.083516 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:20.084136 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:20.093540 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:20.097327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:20.098007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:20.098976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:20.099460 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:20.099899 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:20.348790 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:20.358549 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:20.360260 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:20.361607 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-81cd9f04-88b1-43f6-9114-91dd592f81f2 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.283970 Sep 06 20:23:20.362289 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 543/1044] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:20 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:20.825849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:20.829733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:20.842167 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:20.843094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:20.843948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:20.845170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:20.846075 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:20.846838 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:20.907992 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-b5afc8c4-8288-4d24-9855-9da8b33be48c tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089262 Sep 06 20:23:20.908744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 502/1045] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:20 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:20.923852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:20.924807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:20.932521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:20.933059 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:20.933501 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:20.934483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:20.935474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:20.935474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:20.962798 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] HTTP exception thrown: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Request method failure captured: Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: DELETE /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 HTTP/1.1 Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pRlRTVlLxdqMeviE7q_y_xNZ3p7ejCxymVnpdp13db6bVnnl8v4DXL0c7AFjJAfVyY6NAz4yOtX_vF58wBdUak4I2gdVUyTD9-IWZTSFuhpGhUHb-57iF558zB3SASKK0W1WPWujBY3RSv7UI9kof_cqE-t2IeTx16DEpxo9cKn-U Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:20.966408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: f49ef54a38614cb880577626e65b0e32 Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:20.968357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '22f25258-270e-479e-b6d2-5dc39da2f3a5'} Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:20.969642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:20.975845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:20.978762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Returning 404 to user: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:20.978762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-cc1a6e10-4a47-4905-a9a2-9ea8ed08c4c1 tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 404 len: 111 microversion: 2.1 time: 0.049077 Sep 06 20:23:20.978762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 544/1046] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:20 2022] DELETE /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:20.984741 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:20.985909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] [instance: 22f25258-270e-479e-b6d2-5dc39da2f3a5] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:20.997525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:20.998461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:20.999430 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:21.000968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:21.002348 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:21.003220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:21.080382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] HTTP exception thrown: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Request method failure captured: Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 HTTP/1.1 Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pRlRTVlLxdqMeviE7q_y_xNZ3p7ejCxymVnpdp13db6bVnnl8v4DXL0c7AFjJAfVyY6NAz4yOtX_vF58wBdUak4I2gdVUyTD9-IWZTSFuhpGhUHb-57iF558zB3SASKK0W1WPWujBY3RSv7UI9kof_cqE-t2IeTx16DEpxo9cKn-U Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:21.088239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/27f27bdf0ac14f62b682027b05b219ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 27f27bdf0ac14f62b682027b05b219ee Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-891360769 Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: f49ef54a38614cb880577626e65b0e32 Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeTestJSON-891360769-project Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:21.091308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '22f25258-270e-479e-b6d2-5dc39da2f3a5'} Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:21.092785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. Sep 06 20:23:21.095337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:21.103614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] Returning 404 to user: Instance 22f25258-270e-479e-b6d2-5dc39da2f3a5 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:21.104448 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2f2e0f52-7b83-4078-9399-1d64311c5cfe tempest-AttachVolumeTestJSON-891360769 tempest-AttachVolumeTestJSON-891360769-project] 10.222.0.20 "GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5" status: 404 len: 111 microversion: 2.1 time: 0.127183 Sep 06 20:23:21.106699 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 503/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:20 2022] GET /compute/v2.1/servers/22f25258-270e-479e-b6d2-5dc39da2f3a5 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:21.395111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:21.397576 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:21.406680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:21.407946 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:21.408383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:21.409338 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:21.410054 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:21.410741 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:21.611600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:21.628220 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:21.630159 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:21.631891 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b6abe55e-dfcd-4c40-93bc-c47af5941e20 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.246755 Sep 06 20:23:21.664744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 545/1048] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:21 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:21.930360 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:21.952803 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:21.980796 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:21.981342 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:21.983909 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:21.985170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:21.985990 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:21.986683 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:22.049272 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3b8bf94e-e34e-4f16-84b3-7eca91af722a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129493 Sep 06 20:23:22.055033 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 504/1049] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:21 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:22.673301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:22.674484 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:22.691977 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:22.693782 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:22.695897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:22.698623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:22.707695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:22.710242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:23.068782 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:23.083516 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:23.111902 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:23.113382 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:23.114544 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:23.126977 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:23.128477 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:23.131105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:23.150624 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:23.168316 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:23.171998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:23.174247 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-398c70cb-c6b4-477d-b230-d58358c793d6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.508404 Sep 06 20:23:23.175567 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 546/1050] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:22 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:23.237990 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a782fd7e-63f7-40ac-9ef5-07fc03fc6e69 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177446 Sep 06 20:23:23.245681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 505/1051] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:23 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:24.207919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:24.208964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:24.220879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:24.221737 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:24.222406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:24.223658 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:24.224520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:24.225843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:24.255493 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:24.258609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:24.275836 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:24.276708 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:24.277951 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:24.278961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:24.279659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:24.283058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:24.424046 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-73507f0f-cff7-496d-bcbb-28c6cfedc884 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168171 Sep 06 20:23:24.425129 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 506/1052] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:24 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:23:24.682463 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:24.699804 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:24.703489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:24.706375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c64327cb-8229-420b-87e8-cd43cac0bb70 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.503414 Sep 06 20:23:24.718703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 547/1053] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:24 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:25.440845 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:25.444342 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:25.463119 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:25.464030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:25.464714 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:25.466172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:25.466968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:25.467648 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:25.547449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-81a67aee-60e4-4735-b537-185b22c1c168 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110953 Sep 06 20:23:25.548872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 507/1054] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:25 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:23:25.779183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:25.783138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:25.798210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:25.799604 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:25.800716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:25.802505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:25.803438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:25.804244 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:26.107149 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:26.135426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:26.141852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:26.144830 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-bff1b0d8-9594-4b98-9373-65a6fadc874d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.392471 Sep 06 20:23:26.146372 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 548/1055] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:25 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:26.582135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:26.586244 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:26.596638 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:26.597872 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:26.599239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:26.601121 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:26.602005 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:26.603596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:26.658949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:UPDATE=7 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:26.747044 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d7db64d2-7f7c-4826-bf57-bf8d81d3a870 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189474 Sep 06 20:23:26.755289 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 508/1056] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:26 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:27.185083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:27.188248 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:27.193594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:27.204239 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:27.211414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:27.212686 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:27.214412 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:27.215656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:27.216960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:27.583861 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:27.597112 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:27.600113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:27.601879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6784a60d-d4b4-4280-a5ad-ae68987bfb1d tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.428784 Sep 06 20:23:27.619808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 549/1057] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:27 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:27.769135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:27.776785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:27.801392 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:27.801935 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:27.802385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:27.803676 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:27.804144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:27.804578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:27.923308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-683274e3-0c3b-4b32-aa7b-cc076f665c28 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162338 Sep 06 20:23:27.925197 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 509/1058] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:27 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:28.648447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:28.650384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:28.663175 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:28.666347 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:28.666927 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:28.668007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:28.668678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:28.669403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:28.841635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:28.852148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:28.854213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:28.856080 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-eaa444eb-c529-4718-bece-0a38ab0f1f95 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.223747 Sep 06 20:23:28.856937 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 550/1059] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:28 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:28.948331 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:28.957039 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:28.977915 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:28.984200 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:28.985780 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:28.994804 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:28.996597 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:28.997484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:29.098492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ba258bd4-a2ba-4292-a0f8-d0968540a8d1 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157622 Sep 06 20:23:29.115790 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 510/1060] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:28 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:29.889634 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:29.891071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:29.901987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:29.906473 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:29.907342 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:29.910807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:29.911616 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:29.912387 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:30.121525 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:30.135923 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:30.173482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:30.173482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:30.173482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:30.173482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:30.175051 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:30.175051 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:30.247043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-740b7c23-a4c4-446c-a306-9e1b59b0d85f tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133856 Sep 06 20:23:30.248712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 511/1061] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:30 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:30.427892 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:30.445925 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:30.452231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:30.457008 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5db745d1-5974-40d2-bcea-8a0920d25062 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.571410 Sep 06 20:23:30.459578 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 551/1062] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:29 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:31.266496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:31.272341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:31.291019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:31.293946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:31.295048 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:31.302964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:31.303873 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:31.304596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:31.363994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e1282b38-a6b3-410c-b34c-695db639eda7 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105844 Sep 06 20:23:31.364677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 512/1063] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:31 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:23:31.494240 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:31.495324 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:31.509897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:31.510786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:31.511569 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:31.512882 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:31.513751 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:31.514522 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:31.623537 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1848114669", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-556363554", "security_groups": [{"name": "tempest-secgroup-smoke-1329946770"}], "block_device_mapping_v2": [{"uuid": "00c8eb4e-f82e-40d7-98b0-d4aa1ced9b64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "91efb276-dca9-4ee1-91ca-f3bfd747bb6a"}]}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:31.783513 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:31.795889 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:31.797966 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:31.800512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b1f13f34-a2a1-446d-a385-b0b4aac07468 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.311724 Sep 06 20:23:31.801403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 552/1064] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:31 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:31.869766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] validate_networks() for [('91efb276-dca9-4ee1-91ca-f3bfd747bb6a', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:23:32.384576 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:32.388209 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:32.395513 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:32.396153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:32.398022 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:32.399661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:32.400591 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:32.401273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:32.467935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8673649a-92fc-4fe5-8601-7f6f197d61b6 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084683 Sep 06 20:23:32.467935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 553/1065] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:32 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:23:32.507534 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:23:32.508298 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:23:32.509100 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:23:32.510025 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:23:32.510854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:23:32.527873 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:32.528690 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:32.529204 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:32.530195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:32.530928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:32.531989 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:32.554496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for project ed4697b9e0a940b284b392b3e93197c7. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:23:32.558463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for user 7f661aa1f00e4c7e916b2498505475dc and project ed4697b9e0a940b284b392b3e93197c7. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:23:32.642977 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:23:32.645876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00c8eb4e-f82e-40d7-98b0-d4aa1ced9b64',volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:23:32.849869 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:32.851323 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:32.860252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:32.861198 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:32.861815 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:32.862596 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:32.863278 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:32.863960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:32.886297 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-cf2cc803-a0ad-492f-832b-a658634ff435 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.271197 Sep 06 20:23:32.887532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 513/1066] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:23:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:23:32.904782 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-33366ca2-219f-488b-99f3-99296a35fe15 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:32.906425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-33366ca2-219f-488b-99f3-99296a35fe15 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:33.005910 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-33366ca2-219f-488b-99f3-99296a35fe15 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:33.016580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-33366ca2-219f-488b-99f3-99296a35fe15 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1094 microversion: 2.1 time: 0.120055 Sep 06 20:23:33.023190 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 514/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:32 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:33.093387 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:33.106421 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:33.109899 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:33.111480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-fb574356-d48a-452a-9769-52df5f170224 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.267709 Sep 06 20:23:33.112448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 554/1068] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:32 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:33.483325 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:33.488032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:33.504616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:33.507057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:33.508263 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:33.511776 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:33.512850 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:33.513300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:33.553656 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:33.556962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:33.562410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-52a70b01-4a44-40bb-9bd8-45e770f57180 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086418 Sep 06 20:23:33.563261 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 515/1069] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:33 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:33.578632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:33.579875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:33.580716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:33.582385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:33.583101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:33.584304 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:33.752057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'services' on Instance uuid f04fc08f-4410-47c3-9d79-63795cc3c756 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:23:33.894625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8f90822d-9715-470e-8c02-5d0bf1776eda tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments/b8197c0d-5578-45db-aee6-8a09ee9e0b9c" status: 202 len: 0 microversion: 2.1 time: 0.348099 Sep 06 20:23:33.896023 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 555/1070] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:23:33 2022] DELETE /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments/b8197c0d-5578-45db-aee6-8a09ee9e0b9c => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:23:33.905888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:33.908444 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:33.916588 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:33.917111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:33.917554 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:33.918546 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:33.919254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:33.919678 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:33.958115 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-04f49ba6-40c9-4cea-9fd3-ba7a2841bf22 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057333 Sep 06 20:23:33.958814 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 516/1071] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:33 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:23:34.059971 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:34.063437 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:34.075687 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.076563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.077488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.079107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.080131 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.081414 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.092471 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:34.163086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:34.164781 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:34.180290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.181873 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.184840 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.187769 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.188945 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.191090 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.257837 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:34.270174 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-88219da9-0d61-4bc7-9865-5e3f1e1f8cce tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1192 microversion: 2.1 time: 0.218683 Sep 06 20:23:34.271073 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 556/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:34 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1192 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:34.460856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:34.477837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:34.480779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:34.483321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-db8e285d-92ed-47b0-a7ac-13830fe9e545 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.332437 Sep 06 20:23:34.484111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 517/1073] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:34 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:34.581500 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:34.584827 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:34.592051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.592554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.593004 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.593813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.594287 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.594901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.670419 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6ff11ed1-6433-4b40-bea2-0881ba692029 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094483 Sep 06 20:23:34.672820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 557/1074] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:34 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 20:23:34.688199 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:34.688991 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:34.696481 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.697041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.697483 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.698341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.699015 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.699602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.808370 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] HTTP exception thrown: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 is not attached to volume c282c92f-7a26-4ebd-8862-3dd9a6564933 Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Request method failure captured: Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments/c282c92f-7a26-4ebd-8862-3dd9a6564933 HTTP/1.1 Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6uL64-GZaNn8ziPv5ypX-kZWjvUvoRW86vPkSVNPgTX9_5fI638W-D3R72Us4gShp_CpMVer-2wDMXLrzZ7duXpuunPJTDvkNO57D-d8407jNHrAFXj2DjfvHZB9v2uP8RWLPpIIS3dIZDCAA6cicD17DRGmRlSZvLiOiDJxEBPXRk Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 48d7280f7ee04d389193da7bf05eaf1a Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-TestMinimumBasicScenario-716839877 Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:34.815598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-TestMinimumBasicScenario-716839877 Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 48d7280f7ee04d389193da7bf05eaf1a Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-716839877 Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-TestMinimumBasicScenario-716839877-project Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: a385e6b1f23d449f8738a6f87720184d Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-TestMinimumBasicScenario-716839877-project Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:34.819478 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 is not attached to volume c282c92f-7a26-4ebd-8862-3dd9a6564933 Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'server_id': 'cefab8aa-8f04-40bf-b79e-8d360f621421', 'id': 'c282c92f-7a26-4ebd-8862-3dd9a6564933'} Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c282c92f-7a26-4ebd-8862-3dd9a6564933. Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:34.822002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 is not attached to volume c282c92f-7a26-4ebd-8862-3dd9a6564933 Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 is not attached to volume c282c92f-7a26-4ebd-8862-3dd9a6564933 Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:34.824491 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Returning 404 to user: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 is not attached to volume c282c92f-7a26-4ebd-8862-3dd9a6564933 {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:34.826787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-10bf84b0-5851-45af-a1bb-de16403f3756 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments/c282c92f-7a26-4ebd-8862-3dd9a6564933" status: 404 len: 154 microversion: 2.1 time: 0.136209 Sep 06 20:23:34.826787 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 518/1075] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 6 20:23:34 2022] DELETE /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421/os-volume_attachments/c282c92f-7a26-4ebd-8862-3dd9a6564933 => generated 154 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:34.980716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:34.984792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:34.996813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:34.997698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:34.998481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:34.999815 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:35.000615 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:35.001392 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:35.057707 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-279bd628-7180-4c80-8f3b-6fe69b029e1e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085827 Sep 06 20:23:35.058975 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 558/1076] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:34 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:35.307370 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:35.308104 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:35.316612 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:35.317875 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:35.318641 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:35.319913 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:35.320842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:35.321584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:35.414209 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:35.426052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4d786692-d021-4bf4-92a9-5f5b709f6108 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1200 microversion: 2.1 time: 0.121850 Sep 06 20:23:35.430255 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 519/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:35 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1200 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:35.528183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:35.529669 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:35.542101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:35.544390 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:35.545475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:35.547029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:35.548135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:35.549436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:35.987331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:36.005900 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:36.009356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:36.011983 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-476f67a4-a351-431f-8da2-4291b7354c29 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.493820 Sep 06 20:23:36.031474 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 559/1078] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:35 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:36.076014 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:36.081704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:36.097918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:36.098802 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:36.099681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.100087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.100553 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.101356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.101917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.102361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.107241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.108291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.109113 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.110254 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.111057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.111726 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.146844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:23:36.248902 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d97c0f24-7f32-45e7-ad82-fa60e74ae03b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.177465 Sep 06 20:23:36.266279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 520/1079] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 6 20:23:36 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756/os-volume_attachments => generated 25 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 20:23:36.345227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e6bc3a21-a9b1-481a-8a49-43be65583cf5 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 204 len: 0 microversion: 2.1 time: 0.257861 Sep 06 20:23:36.351461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 560/1080] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:36 2022] DELETE /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 20:23:36.365957 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:36.370073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:36.392979 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.396110 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.399288 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.401099 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.410640 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.412130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.462860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:36.465650 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:36.488299 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.492689 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.493514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.497649 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.498484 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.499176 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.664343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:36.680010 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-cd16ba10-ab92-43a4-98c5-421d294f7e24 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1555 microversion: 2.1 time: 0.321457 Sep 06 20:23:36.681081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 521/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:36 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1555 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:36.691195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:36.692026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:36.703282 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.704908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.706274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.707973 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.709822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.711169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.726731 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:36.745363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2e8f785d-bb47-45e0-813a-ad59788444ec tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1210 microversion: 2.1 time: 0.297619 Sep 06 20:23:36.746599 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 561/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:36 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1210 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:36.758231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:23:36.920308 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-31625921-a20c-4a4a-bc19-33e0abd5af4b tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 204 len: 0 microversion: 2.1 time: 0.237000 Sep 06 20:23:36.921039 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 522/1083] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:36 2022] DELETE /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:23:36.936773 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:36.937954 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:36.966081 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.968385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.970151 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:36.971868 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:36.972931 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:36.974060 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.056174 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:37.056997 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:37.064549 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:37.065522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:37.066299 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.067792 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:37.069217 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:37.070037 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.274617 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:37.279645 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:37.285924 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:37.289939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:37.289939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c584c26f-c0fe-4635-8b78-1aaa05207fde tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.236860 Sep 06 20:23:37.289939 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 523/1084] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:37 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:37.312970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1051ec8a-eee4-459f-a5bf-831c0911dfee tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1681 microversion: 2.1 time: 0.384094 Sep 06 20:23:37.314812 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 562/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:36 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1681 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:37.567355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-c1327e05-d9d6-4e53-99c9-2bcbcbae0d91 req-0a888ce4-dd6d-4271-b7ad-f4b35cc171a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ac635-8d07-41f0-97d5-f0e81e70b51b", "name": "network-vif-plugged", "status": "completed", "tag": "26463c3c-fa68-45c1-9baa-cb0cf6ff34ec"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:37.575722 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:37.586624 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-c1327e05-d9d6-4e53-99c9-2bcbcbae0d91 req-0a888ce4-dd6d-4271-b7ad-f4b35cc171a7 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:37.587214 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-c1327e05-d9d6-4e53-99c9-2bcbcbae0d91 req-0a888ce4-dd6d-4271-b7ad-f4b35cc171a7 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:37.587656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-c1327e05-d9d6-4e53-99c9-2bcbcbae0d91 req-0a888ce4-dd6d-4271-b7ad-f4b35cc171a7 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.604383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-c1327e05-d9d6-4e53-99c9-2bcbcbae0d91 req-0a888ce4-dd6d-4271-b7ad-f4b35cc171a7 service nova] Creating event network-vif-plugged:26463c3c-fa68-45c1-9baa-cb0cf6ff34ec for instance a53ac635-8d07-41f0-97d5-f0e81e70b51b on hv-cinder-84773 Sep 06 20:23:37.610366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-c1327e05-d9d6-4e53-99c9-2bcbcbae0d91 req-0a888ce4-dd6d-4271-b7ad-f4b35cc171a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047466 Sep 06 20:23:37.611305 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 524/1086] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:37.707541 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:37.708660 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:37.715928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:37.717024 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:37.717606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.718384 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:37.718865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:37.719297 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.790739 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:37.791347 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:37.799516 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:37.800305 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:37.800934 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.814709 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:37.815356 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:37.816011 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:37.838417 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:37.936043 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:37.947120 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1e94929b-c791-460b-a90d-f242ca9dafee tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1555 microversion: 2.1 time: 0.244581 Sep 06 20:23:37.948195 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 563/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:37 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:38.079616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:38.096726 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9a3b9fa7-f80b-46b8-848d-1e334c483ded tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1278 microversion: 2.1 time: 0.312604 Sep 06 20:23:38.097498 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 525/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:37 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1278 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:38.321918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:38.322764 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:38.330692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:38.331049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:38.331767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:38.332979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:38.334079 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:38.334484 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:38.359540 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:38.360835 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:38.374689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:38.375522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:38.376216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:38.377474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:38.378646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:38.379576 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:38.584948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:38.607629 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:38.611647 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:38.614273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ec9c1a89-1c12-47b8-b288-39bb3e05cc84 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.298565 Sep 06 20:23:38.616144 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 564/1089] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:38 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:38.625519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:38.642470 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7089033c-95d7-4063-9450-6fb05842da24 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1681 microversion: 2.1 time: 0.290296 Sep 06 20:23:38.643541 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 526/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:38 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1681 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:38.979794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:38.980919 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:38.992557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:38.993439 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:38.994261 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:38.995597 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:38.996458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:38.997243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:39.129891 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:39.131705 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:39.144251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:39.145548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:39.146930 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:39.148251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:39.149095 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:39.150158 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:39.193561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:39.208454 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f951cb6e-3e6b-4c9c-b900-6476ba7a0569 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1555 microversion: 2.1 time: 0.235867 Sep 06 20:23:39.210056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 565/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:38 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:39.382283 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:39.396961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6aac6ea1-229e-4b47-b7ba-8fdefc7fe7b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1278 microversion: 2.1 time: 0.273558 Sep 06 20:23:39.398434 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 527/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:39 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:39.653076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:39.656495 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:39.669737 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:39.670753 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:39.679704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:39.680632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:39.681088 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:39.681677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:39.682644 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:39.683093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:39.695734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:39.696583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:39.697426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:39.698797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:39.699714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:39.700557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:39.978463 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:39.988120 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-48a8d5fc-9515-4a81-aca3-43d5c9961b35 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1681 microversion: 2.1 time: 0.322720 Sep 06 20:23:39.989411 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 528/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:39 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1681 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:40.180916 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:40.218632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:40.220972 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:40.223599 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-db896445-e605-46b6-baaf-8120ddac4aa0 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.582438 Sep 06 20:23:40.240063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:40.240063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:40.241404 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 566/1094] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:39 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:40.256246 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:40.257341 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:40.257918 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:40.259016 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:40.259654 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:40.260116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:40.435714 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:40.436897 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:40.451504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:40.452961 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:40.453894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:40.455375 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:40.456537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:40.457695 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:40.810705 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:40.829282 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f0be2c43-f130-498f-a354-ba2e2798dc1b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.402559 Sep 06 20:23:40.830160 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 567/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:40 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:40.921767 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-e6b0f3a4-79af-497e-88d2-922440719132 req-a5b9e913-ff5c-44f3-81c8-ba46b0182554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fd9b1e-42f7-4866-9581-cd510ab72f07", "tag": "bae9f4be-00e2-46b1-b212-d046ee0329f6"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:40.955561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e6b0f3a4-79af-497e-88d2-922440719132 req-a5b9e913-ff5c-44f3-81c8-ba46b0182554 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:40.957736 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e6b0f3a4-79af-497e-88d2-922440719132 req-a5b9e913-ff5c-44f3-81c8-ba46b0182554 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:40.958600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e6b0f3a4-79af-497e-88d2-922440719132 req-a5b9e913-ff5c-44f3-81c8-ba46b0182554 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:41.000841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-e6b0f3a4-79af-497e-88d2-922440719132 req-a5b9e913-ff5c-44f3-81c8-ba46b0182554 service nova] Creating event network-changed:bae9f4be-00e2-46b1-b212-d046ee0329f6 for instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 on hv-cinder-84773 Sep 06 20:23:41.012001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-e6b0f3a4-79af-497e-88d2-922440719132 req-a5b9e913-ff5c-44f3-81c8-ba46b0182554 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093932 Sep 06 20:23:41.014529 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 568/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:41.052380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:41.055191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:41.108028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:41.118083 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:41.118848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:41.120117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:41.120924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:41.122458 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:41.137190 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:41.178124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-50baf35e-d0e1-45f6-b0a7-074efbad416d tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1555 microversion: 2.1 time: 0.942091 Sep 06 20:23:41.184388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 529/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:40 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1555 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:41.278009 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:41.279801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:41.309366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:41.311635 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:41.313213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:41.314618 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:41.315474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:41.316239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:41.516166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:41.531995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-eeb0d77f-2545-4926-b61a-66a3d0b77a5e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1681 microversion: 2.1 time: 0.491916 Sep 06 20:23:41.533341 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 569/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:41 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1681 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:41.870386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:41.871905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:41.882129 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:41.882933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:41.883628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:41.884702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:41.885358 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:41.886290 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:41.993565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:42.008442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:42.010029 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:42.011647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-73a7134c-f1af-4350-9cf7-b62609e9c476 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.744672 Sep 06 20:23:42.012244 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 530/1099] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:41 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:23:42.156826 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:42.168711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d333f50b-49b9-4c3b-a31a-e9771df89eee tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.303928 Sep 06 20:23:42.169631 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 570/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:41 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:42.203883 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:42.204513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:42.219300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:42.219300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:42.220951 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:42.221866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:42.222355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:42.222801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:42.304292 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-e95c5016-7452-4e91-b9d5-a7c20d37fc3f req-24c26770-338f-4eea-a1ec-d7a091ca1c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cefab8aa-8f04-40bf-b79e-8d360f621421", "name": "network-vif-deleted", "tag": "03bf2ca5-99d4-4234-8de2-d6f243ea50d8"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:42.316287 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e95c5016-7452-4e91-b9d5-a7c20d37fc3f req-24c26770-338f-4eea-a1ec-d7a091ca1c29 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:42.317132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e95c5016-7452-4e91-b9d5-a7c20d37fc3f req-24c26770-338f-4eea-a1ec-d7a091ca1c29 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:42.318281 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e95c5016-7452-4e91-b9d5-a7c20d37fc3f req-24c26770-338f-4eea-a1ec-d7a091ca1c29 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:42.337094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-e95c5016-7452-4e91-b9d5-a7c20d37fc3f req-24c26770-338f-4eea-a1ec-d7a091ca1c29 service nova] Creating event network-vif-deleted:03bf2ca5-99d4-4234-8de2-d6f243ea50d8 for instance cefab8aa-8f04-40bf-b79e-8d360f621421 on hv-cinder-84773 Sep 06 20:23:42.344730 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-e95c5016-7452-4e91-b9d5-a7c20d37fc3f req-24c26770-338f-4eea-a1ec-d7a091ca1c29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044364 Sep 06 20:23:42.345554 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 571/1101] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:42.420854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:42.432144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0206dbdd-ed1f-4a86-9318-58d0f4e64fb2 tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1513 microversion: 2.1 time: 0.232566 Sep 06 20:23:42.433410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 531/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:42 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:42.578128 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:42.579469 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:42.590444 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:42.595351 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:42.596219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:42.600995 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:42.602150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:42.604309 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:42.697551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:42.829430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:42.847831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9df4fb71-a648-4681-bf03-79d2b909a389 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1613 microversion: 2.1 time: 0.278560 Sep 06 20:23:42.869732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 572/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:42 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1613 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:43.092081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:43.096452 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:43.106781 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:43.111371 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=8 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:43.158519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.160052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.160985 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.163092 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.164203 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.165124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.225553 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:43.229110 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:43.256817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.258732 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.260030 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.263524 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.265417 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.266713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.680925 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:43.700992 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:43.704994 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:43.711334 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c4df58fa-06b6-46ca-bada-4f6645419a6f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.634593 Sep 06 20:23:43.713418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 532/1104] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:43 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:43.723466 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:43.725500 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:43.737056 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.738332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.739321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.740879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.742100 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.743094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.823034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.824059 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.824833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.825842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lazy-loading 'fault' on Instance uuid cefab8aa-8f04-40bf-b79e-8d360f621421 {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:23:43.839974 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:43.850127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a2b2b77c-3952-457d-be68-b66298d8cd68 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.650250 Sep 06 20:23:43.855969 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 573/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:43 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:43.899354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:43.900976 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:43.909006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385e6b1f23d449f8738a6f87720184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d7280f7ee04d389193da7bf05eaf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:43.917438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.917438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.917438 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.917984 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.918661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.919315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.930265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ea2a9b71-9cfd-458c-9e50-66de453b71bb tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 200 len: 1349 microversion: 2.1 time: 0.213768 Sep 06 20:23:43.932661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 533/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:43 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 1349 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:43.977398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:43.977948 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:43.978581 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:43.978831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lazy-loading 'fault' on Instance uuid f04fc08f-4410-47c3-9d79-63795cc3c756 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:23:44.032915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad400ce73b644938aef19e2da731c4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8966ff4bda461aa40251ac9740d172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:44.049979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a410a69f-a233-481b-8c76-244e374cb2ae tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 200 len: 1330 microversion: 2.1 time: 0.157501 Sep 06 20:23:44.054267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 574/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:43 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 1330 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:44.400278 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-4d26a805-2c30-44fb-bf88-153a1ed97bfb req-67f09913-14ca-4604-a7e6-3cb3017534d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04fc08f-4410-47c3-9d79-63795cc3c756", "name": "network-vif-deleted", "tag": "a3fcd08d-b886-43f9-8ff6-119e4c3e0333"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:44.436928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4d26a805-2c30-44fb-bf88-153a1ed97bfb req-67f09913-14ca-4604-a7e6-3cb3017534d9 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:44.437444 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4d26a805-2c30-44fb-bf88-153a1ed97bfb req-67f09913-14ca-4604-a7e6-3cb3017534d9 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:44.439692 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4d26a805-2c30-44fb-bf88-153a1ed97bfb req-67f09913-14ca-4604-a7e6-3cb3017534d9 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:44.472043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-4d26a805-2c30-44fb-bf88-153a1ed97bfb req-67f09913-14ca-4604-a7e6-3cb3017534d9 service nova] Creating event network-vif-deleted:a3fcd08d-b886-43f9-8ff6-119e4c3e0333 for instance f04fc08f-4410-47c3-9d79-63795cc3c756 on hv-cinder-84773 Sep 06 20:23:44.481161 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-4d26a805-2c30-44fb-bf88-153a1ed97bfb req-67f09913-14ca-4604-a7e6-3cb3017534d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094115 Sep 06 20:23:44.482897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 534/1108] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:44.745565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:44.747635 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:44.760062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:44.762057 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:44.762943 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:44.764026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:44.764601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:44.765571 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:44.899798 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:44.900885 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:44.920877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:44.921544 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:44.923539 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:44.926196 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:44.927344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:44.927816 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:45.083991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:45.107035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:45.110727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:45.114127 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a4e182cf-a683-4730-aa27-64c858def481 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1729 microversion: 2.20 time: 0.373247 Sep 06 20:23:45.116531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 575/1109] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:44 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1729 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:45.127824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:45.130040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] [instance: cefab8aa-8f04-40bf-b79e-8d360f621421] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:45.144589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:45.146583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:45.147700 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:45.150625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:45.152633 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:45.154064 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:45.191981 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] HTTP exception thrown: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 could not be found. Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Request method failure captured: Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 HTTP/1.1 Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6uL64-GZaNn8ziPv5ypX-kZWjvUvoRW86vPkSVNPgTX9_5fI638W-D3R72Us4gShp_CpMVer-2wDMXLrzZ7duXpuunPJTDvkNO57D-d8407jNHrAFXj2DjfvHZB9v2uP8RWLPpIIS3dIZDCAA6cicD17DRGmRlSZvLiOiDJxEBPXRk Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 48d7280f7ee04d389193da7bf05eaf1a Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-TestMinimumBasicScenario-716839877 Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:45.199625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d7280f7ee04d389193da7bf05eaf1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-TestMinimumBasicScenario-716839877 Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 48d7280f7ee04d389193da7bf05eaf1a Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-TestMinimumBasicScenario-716839877 Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-TestMinimumBasicScenario-716839877-project Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: a385e6b1f23d449f8738a6f87720184d Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-TestMinimumBasicScenario-716839877-project Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 could not be found. Sep 06 20:23:45.202542 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'cefab8aa-8f04-40bf-b79e-8d360f621421'} Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 could not be found. Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:45.204212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 could not be found. Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 could not be found. Sep 06 20:23:45.206980 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.212126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Returning 404 to user: Instance cefab8aa-8f04-40bf-b79e-8d360f621421 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:45.214064 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9f1b4d52-611d-47f3-b7b7-b23eff38385a tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421" status: 404 len: 111 microversion: 2.1 time: 0.095378 Sep 06 20:23:45.215350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 576/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:45 2022] GET /compute/v2.1/servers/cefab8aa-8f04-40bf-b79e-8d360f621421 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:45.221782 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:45.234586 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:45.236259 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:45.238172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1226ce5e-b0ce-41e0-ae65-f9f014ec1c08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.344332 Sep 06 20:23:45.239677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 535/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:44 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:45.252545 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:45.254301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:45.255898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:45.256105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-79953aeb-08c6-4ab4-aaa6-939e33e7dfbd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] Calling method '.version_select at 0x7f9c3bab2ca0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:45.257678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:45.258803 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:45.259862 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:45.292924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 HTTP/1.1 Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:45.297049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:45.300067 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'f04fc08f-4410-47c3-9d79-63795cc3c756'} Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:45.301728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:45.304531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:45.307090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:45.307090 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-03ddc872-814f-4657-853a-1cee736f468d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 404 len: 111 microversion: 2.1 time: 0.089787 Sep 06 20:23:45.308379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 577/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:45 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:45.323681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6f2f4553-0ba8-4aa3-9a0a-60aa0092727a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '.version_select at 0x7f9c37a9df70>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:45.343208 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-79953aeb-08c6-4ab4-aaa6-939e33e7dfbd tempest-TestMinimumBasicScenario-716839877 tempest-TestMinimumBasicScenario-716839877-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1083295294" status: 202 len: 0 microversion: 2.1 time: 0.101799 Sep 06 20:23:45.351013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 536/1113] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 6 20:23:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1083295294 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:23:45.366628 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6f2f4553-0ba8-4aa3-9a0a-60aa0092727a tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856679363" status: 202 len: 0 microversion: 2.1 time: 0.050237 Sep 06 20:23:45.369754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 578/1114] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 6 20:23:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856679363 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:23:46.172849 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:46.173795 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:46.182157 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:46.182871 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:46.183509 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:46.184733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:46.185756 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:46.186458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:46.271699 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:46.272537 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:46.291765 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:46.292617 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:46.293321 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:46.294380 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:46.295401 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:46.296089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:46.494399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:46.511421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:46.513595 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:46.516023 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9c06a2ef-ad7b-4c17-adb5-4d3352cfc8bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1716 microversion: 2.20 time: 0.346931 Sep 06 20:23:46.517156 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 537/1115] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:23:46 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1716 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:23:46.685062 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:46.717345 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-115abb8b-ff9b-4ed3-9aa8-029f4e4ab82c tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.451344 Sep 06 20:23:46.719167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 579/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:46 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:47.746535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:47.747822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:47.756812 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:47.757551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:47.758472 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:47.759806 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:47.762605 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:47.762854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:48.153002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:48.167786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-15267846-ea47-4f83-9e48-470e137cd86e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.425440 Sep 06 20:23:48.168825 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 538/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:47 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:48.345639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:48.347036 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:48.355557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:48.356049 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:48.356893 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:48.357682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:48.358143 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:48.358601 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:48.375353 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: DELETE /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 HTTP/1.1 Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:48.377001 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.378905 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'f04fc08f-4410-47c3-9d79-63795cc3c756'} Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:48.384434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.386426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.388436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:48.388436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7bef6191-6700-497a-af48-ccce17c599e1 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 404 len: 111 microversion: 2.1 time: 0.040641 Sep 06 20:23:48.388436 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 580/1118] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:48 2022] DELETE /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:48.399248 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:48.401489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: f04fc08f-4410-47c3-9d79-63795cc3c756] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:48.414766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:48.415964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:48.416822 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:48.418309 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:48.419538 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:48.420570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:48.441514 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 HTTP/1.1 Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:48.444632 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.446746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'f04fc08f-4410-47c3-9d79-63795cc3c756'} Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:48.452249 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. Sep 06 20:23:48.455132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:48.458496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance f04fc08f-4410-47c3-9d79-63795cc3c756 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:48.458496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-03dfd6fc-969b-45a6-a90b-941a9b0f5e6d tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756" status: 404 len: 111 microversion: 2.1 time: 0.056363 Sep 06 20:23:48.458496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 539/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:48 2022] GET /compute/v2.1/servers/f04fc08f-4410-47c3-9d79-63795cc3c756 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:49.202153 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:49.203031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:49.212651 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.213319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.214762 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.215327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.216097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.217604 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.444245 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:49.461991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c13fd551-2509-4791-9eca-2f582347cdb0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.267789 Sep 06 20:23:49.463019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 581/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:49 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:23:49.742090 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:49.742895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:49.751904 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.752961 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.753578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.754633 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.757492 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.758505 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.787337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 HTTP/1.1 Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:49.791974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.793964 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '3bf0941f-e94c-48a0-b1a3-7848bce394f7'} Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:49.795034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.796799 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.799519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:49.801511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-30223e0a-9394-47a2-9a14-41498be888ba tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 404 len: 111 microversion: 2.1 time: 0.063566 Sep 06 20:23:49.810946 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 540/1121] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:49 2022] DELETE /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 20:23:49.814398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:49.815026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 3bf0941f-e94c-48a0-b1a3-7848bce394f7] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:49.824456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.829075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.829594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.835843 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.836671 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.837140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.867365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 HTTP/1.1 Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:49.876000 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.879119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '3bf0941f-e94c-48a0-b1a3-7848bce394f7'} Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:49.881092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. Sep 06 20:23:49.883787 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.890570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 3bf0941f-e94c-48a0-b1a3-7848bce394f7 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:49.890570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8ae43df7-335b-472f-82e4-caa6d209036c tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7" status: 404 len: 111 microversion: 2.1 time: 0.068121 Sep 06 20:23:49.890570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 582/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:49 2022] GET /compute/v2.1/servers/3bf0941f-e94c-48a0-b1a3-7848bce394f7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:49.895299 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:49.896294 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:49.916847 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.918394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.919390 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.920795 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:49.921876 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:49.923030 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:49.954399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 HTTP/1.1 Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:49.958421 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:49.961140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '475e333a-a670-43c9-b18b-251a960ede71'} Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:49.962671 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:49.965061 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:49.970042 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:49.972099 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-04e46ea5-8c70-4039-bd0c-efffa70d986e tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 404 len: 111 microversion: 2.1 time: 0.085101 Sep 06 20:23:49.978393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 541/1123] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:49 2022] DELETE /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:49.990865 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:49.992613 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 475e333a-a670-43c9-b18b-251a960ede71] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:50.004109 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:50.005661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:50.006383 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:50.007673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:50.009521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:50.009521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:50.038325 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 HTTP/1.1 Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:50.041558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:50.044434 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '475e333a-a670-43c9-b18b-251a960ede71'} Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:50.046752 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. Sep 06 20:23:50.050718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:50.055938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 475e333a-a670-43c9-b18b-251a960ede71 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:50.055938 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9237e40f-1c39-4f7d-a5ac-1570b58fce7f tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71" status: 404 len: 111 microversion: 2.1 time: 0.062911 Sep 06 20:23:50.058320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 583/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:49 2022] GET /compute/v2.1/servers/475e333a-a670-43c9-b18b-251a960ede71 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:50.504481 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:50.506828 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:50.519607 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:50.520823 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:50.521856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:50.523745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:50.524911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:50.525773 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:50.750324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:50.763220 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-5790ec4d-f400-4a3b-96b0-58726f334236 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.266648 Sep 06 20:23:50.763973 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 542/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:50 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:51.293528 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:51.294531 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:51.306831 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:51.307716 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:51.308523 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:51.309858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:51.310684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:51.311803 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:51.340721 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: DELETE /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 HTTP/1.1 Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:23:51.344076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.345932 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '1a69dcaa-e0c4-49b1-a7c4-74e4a5219936'} Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:51.346958 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.349367 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.351182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:51.351182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7d791f9e-9232-4857-beee-5fe722978699 tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 404 len: 111 microversion: 2.1 time: 0.061102 Sep 06 20:23:51.351182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 584/1126] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:23:51 2022] DELETE /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:51.361776 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:51.362738 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] [instance: 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:51.372170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:51.372921 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:51.373987 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:51.375020 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:51.375739 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:51.377260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:51.409527 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] HTTP exception thrown: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Request method failure captured: Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 HTTP/1.1 Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6pbwzapQCrLtN_p8i44BwLOpnjSErl6gC-6fr-LR1MQEXGnAS4qsDnyosmjxapMxsvlH-k63ay0oC6rjy4dCjKbKogvpn9FXoivqK7DUyhsk7U5kzMQzrYgldwcWL4NopSm8hv8Ao8p30s9XuHkIMKEqutrZhdv6-UALtOKFtuKh-U Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:23:51.412649 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a8966ff4bda461aa40251ac9740d172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 4a8966ff4bda461aa40251ac9740d172 Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1884612821 Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: ad400ce73b644938aef19e2da731c4dc Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeNegativeTest-1884612821-project Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.414207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '1a69dcaa-e0c4-49b1-a7c4-74e4a5219936'} Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:23:51.415043 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. Sep 06 20:23:51.416344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:23:51.423551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] Returning 404 to user: Instance 1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:23:51.424906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1a41e6ff-877b-4575-92d6-ce04ec6645cc tempest-AttachVolumeNegativeTest-1884612821 tempest-AttachVolumeNegativeTest-1884612821-project] 10.222.0.20 "GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936" status: 404 len: 111 microversion: 2.1 time: 0.069257 Sep 06 20:23:51.426287 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 543/1127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:51 2022] GET /compute/v2.1/servers/1a69dcaa-e0c4-49b1-a7c4-74e4a5219936 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:23:51.792481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:51.793599 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:51.840688 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:51.841547 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:51.842332 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:51.843611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:51.855674 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:51.856406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:52.443029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:52.461870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ae888691-fcff-4cd1-8773-da3547544170 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.675933 Sep 06 20:23:52.478810 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 585/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:51 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:53.496531 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:53.499480 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:53.511584 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:53.512408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:53.513208 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:53.514458 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:53.515535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:53.516353 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:53.787372 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:53.809207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6d4d25e1-6244-4e01-9eae-750917df8840 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.319910 Sep 06 20:23:53.822189 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 544/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:53 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:54.024715 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-6ac40045-afb9-45ae-a160-5c9fa63d1cb5 req-f89c2aaf-e85f-4709-b2cb-2f042634ef57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd9b1e-42f7-4866-9581-cd510ab72f07", "name": "network-vif-plugged", "status": "completed", "tag": "bae9f4be-00e2-46b1-b212-d046ee0329f6"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:23:54.049269 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-6ac40045-afb9-45ae-a160-5c9fa63d1cb5 req-f89c2aaf-e85f-4709-b2cb-2f042634ef57 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:54.051183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-6ac40045-afb9-45ae-a160-5c9fa63d1cb5 req-f89c2aaf-e85f-4709-b2cb-2f042634ef57 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:54.054047 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-6ac40045-afb9-45ae-a160-5c9fa63d1cb5 req-f89c2aaf-e85f-4709-b2cb-2f042634ef57 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:54.106606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-6ac40045-afb9-45ae-a160-5c9fa63d1cb5 req-f89c2aaf-e85f-4709-b2cb-2f042634ef57 service nova] Creating event network-vif-plugged:bae9f4be-00e2-46b1-b212-d046ee0329f6 for instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 on hv-cinder-84773 Sep 06 20:23:54.112294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-6ac40045-afb9-45ae-a160-5c9fa63d1cb5 req-f89c2aaf-e85f-4709-b2cb-2f042634ef57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101977 Sep 06 20:23:54.113256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 586/1130] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:23:54.837429 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:54.838612 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:54.854971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:54.860211 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:54.862388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:54.867057 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:54.869880 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:54.870470 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:55.277405 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:55.286751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-64ed9411-1cc2-4e28-b6a8-812600f0aa81 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1266 microversion: 2.1 time: 0.456059 Sep 06 20:23:55.302833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 545/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:54 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1266 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:56.326092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:56.330305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:56.352684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:56.353915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:56.354681 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:56.355957 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:56.357040 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:56.358082 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:57.079166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:57.103150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-028e7bc5-bc68-4afd-a7f0-01c808df54e6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1452 microversion: 2.1 time: 0.793357 Sep 06 20:23:57.104312 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 587/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:56 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1452 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:23:57.139013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:23:57.141496 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:23:57.158691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:57.160198 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:57.161153 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:57.173972 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:23:57.175373 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:23:57.177130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:23:57.183003 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=100 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:57.690440 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:23:57.717330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-dae15952-da02-49a5-bace-4bc154e8653d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1452 microversion: 2.1 time: 0.583953 Sep 06 20:23:57.719351 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 546/1133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:23:57 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1452 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:24:01.931107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-e578837f-cf46-40af-baa2-710d19f1952d req-fdfcff7f-02ac-4f4b-b3e3-a13ce166ac73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3fd9b1e-42f7-4866-9581-cd510ab72f07", "tag": "bae9f4be-00e2-46b1-b212-d046ee0329f6"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:01.956204 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:01.982874 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e578837f-cf46-40af-baa2-710d19f1952d req-fdfcff7f-02ac-4f4b-b3e3-a13ce166ac73 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:01.983733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e578837f-cf46-40af-baa2-710d19f1952d req-fdfcff7f-02ac-4f4b-b3e3-a13ce166ac73 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:01.984507 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-e578837f-cf46-40af-baa2-710d19f1952d req-fdfcff7f-02ac-4f4b-b3e3-a13ce166ac73 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:02.041662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-e578837f-cf46-40af-baa2-710d19f1952d req-fdfcff7f-02ac-4f4b-b3e3-a13ce166ac73 service nova] Creating event network-changed:bae9f4be-00e2-46b1-b212-d046ee0329f6 for instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 on hv-cinder-84773 Sep 06 20:24:02.051014 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-e578837f-cf46-40af-baa2-710d19f1952d req-fdfcff7f-02ac-4f4b-b3e3-a13ce166ac73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127331 Sep 06 20:24:02.055543 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 588/1134] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:03.730314 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-60e81b00-9118-4d2b-92ba-564ea8e34257 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Action: 'create', calling method: .version_select at 0x7f9c3be1d5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1374963546"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:04.291552 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-60e81b00-9118-4d2b-92ba-564ea8e34257 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.787399 Sep 06 20:24:04.292359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 547/1135] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Sep 6 20:24:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 790 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 20:24:04.315331 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-61e76252-9239-43a7-bb4f-349753c73b4d tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37ab5670>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:04.383759 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-61e76252-9239-43a7-bb4f-349753c73b4d tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c" status: 200 len: 345 microversion: 2.1 time: 0.079957 Sep 06 20:24:04.384449 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 589/1136] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:04 2022] GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:05.401975 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8fd5bf6c-0c42-4559-b528-341f2da7fa20 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3ba3f280>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:05.458244 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8fd5bf6c-0c42-4559-b528-341f2da7fa20 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c" status: 200 len: 346 microversion: 2.1 time: 0.061396 Sep 06 20:24:05.458842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 548/1137] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:05 2022] GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:05.475758 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ea7fc54f-ca82-4e30-94ba-4afe477fc404 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Action: 'create', calling method: .version_select at 0x7f9c37d993a0>, body: {"snapshot": {"volume_id": "417adbb1-6ac3-45be-a7c4-21d967d83d2c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1623140942"}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:05.692871 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ea7fc54f-ca82-4e30-94ba-4afe477fc404 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.222574 Sep 06 20:24:05.693563 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 590/1138] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 6 20:24:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:05.709457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-cc445a9e-bf03-42a3-901e-913a55716aec tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3bc4aa60>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:05.754623 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-cc445a9e-bf03-42a3-901e-913a55716aec tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 200 len: 287 microversion: 2.1 time: 0.049783 Sep 06 20:24:05.755589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 549/1139] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:05 2022] GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:05.772371 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-72bd8ae9-c20c-44bf-8ca7-b2f1cad62fba tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37a94160>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:05.816744 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-72bd8ae9-c20c-44bf-8ca7-b2f1cad62fba tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.047933 Sep 06 20:24:05.818134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 591/1140] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 20:24:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:05.833146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c3f15ad4-a406-4d40-a0be-8356d8e00820 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3bc82430>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:05.871063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c3f15ad4-a406-4d40-a0be-8356d8e00820 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 200 len: 287 microversion: 2.1 time: 0.043324 Sep 06 20:24:05.872026 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 550/1141] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:05 2022] GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:06.887521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-243065c6-3f25-4841-9457-d1f7736baf4b tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37a87af0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:06.928159 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-243065c6-3f25-4841-9457-d1f7736baf4b tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 200 len: 287 microversion: 2.1 time: 0.045040 Sep 06 20:24:06.928750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 592/1142] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:06 2022] GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:07.938078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:07.938856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=5 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:07.944027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-f513223f-62fb-4996-b678-3cf57223ce93 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3bac5ca0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:07.979589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-f513223f-62fb-4996-b678-3cf57223ce93 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 200 len: 287 microversion: 2.1 time: 0.042674 Sep 06 20:24:07.980237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 551/1143] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:07 2022] GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:08.993183 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4335f9be-6154-49db-a193-192b0905a346 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37a5eaf0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:09.028528 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4335f9be-6154-49db-a193-192b0905a346 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 200 len: 288 microversion: 2.1 time: 0.040023 Sep 06 20:24:09.029215 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 593/1144] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:08 2022] GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:09.043497 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-9ff7b4ac-378f-4bd3-9d88-751084dcb455 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3b9160d0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:09.120970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-9ff7b4ac-378f-4bd3-9d88-751084dcb455 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 202 len: 0 microversion: 2.1 time: 0.082016 Sep 06 20:24:09.121598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 552/1145] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 6 20:24:09 2022] DELETE /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:24:09.134140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1832d306-5b74-45f8-9815-dfed23af14fc tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37a87940>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:09.177314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1832d306-5b74-45f8-9815-dfed23af14fc tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 200 len: 287 microversion: 2.1 time: 0.049319 Sep 06 20:24:09.178506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 594/1146] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:09 2022] GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:10.198604 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c8d82fb6-7c23-41b4-ac86-62425a443347 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3b916ee0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:10.235322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-c8d82fb6-7c23-41b4-ac86-62425a443347 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] HTTP exception thrown: Snapshot 27dea15c-290b-4095-bec3-1811659fac42 could not be found. Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c8d82fb6-7c23-41b4-ac86-62425a443347 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Request method failure captured: Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 HTTP/1.1 Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6xjGa8yzLiefsnksbph44cI4Q4qm3lemKfWP9xHWUTKQMyoKgyvpb-sg0BMOZ2ZrBzXX2xzecFsCQrOYkuPFmZsdmVJ4O7ySTXpmlXweP5oifAOAQetPObypzMp9p9hmbiiGyWPHEtL_hsotych_oz0_HALWKKIz9OuRW972cSPn0w Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:10.249147 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: dc49853bd7f94f8e915835c465f6fc20 Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Snapshot 27dea15c-290b-4095-bec3-1811659fac42 could not be found. Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '27dea15c-290b-4095-bec3-1811659fac42'} Sep 06 20:24:10.252301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 27dea15c-290b-4095-bec3-1811659fac42 could not be found. (HTTP 404) (Request-ID: req-f1fe64fe-0032-4d3c-bcec-df9d8847e237) Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:10.254707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:10.257050 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 27dea15c-290b-4095-bec3-1811659fac42 could not be found. Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 20:24:10.260432 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 27dea15c-290b-4095-bec3-1811659fac42 could not be found. Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 27dea15c-290b-4095-bec3-1811659fac42 could not be found. Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c8d82fb6-7c23-41b4-ac86-62425a443347 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Returning 404 to user: Snapshot 27dea15c-290b-4095-bec3-1811659fac42 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:10.263988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c8d82fb6-7c23-41b4-ac86-62425a443347 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42" status: 404 len: 111 microversion: 2.1 time: 0.059952 Sep 06 20:24:10.266206 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 553/1147] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:10 2022] GET /compute/v2.1/os-snapshots/27dea15c-290b-4095-bec3-1811659fac42 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:10.266471 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d6ac8dd5-f88d-45f6-9328-86ff5b8a78ba tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37a9d310>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:10.358718 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d6ac8dd5-f88d-45f6-9328-86ff5b8a78ba tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c" status: 202 len: 0 microversion: 2.1 time: 0.099033 Sep 06 20:24:10.359676 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 595/1148] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:24:10 2022] DELETE /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:24:10.369888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-286fc9ad-514b-414a-8f93-19def2d9193b tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3f2dd0d0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:10.438867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-286fc9ad-514b-414a-8f93-19def2d9193b tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c" status: 200 len: 345 microversion: 2.1 time: 0.073177 Sep 06 20:24:10.439453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 554/1149] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:10 2022] GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:11.460846 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8926ca26-3980-48e7-97b9-9d8a5ba2adf8 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37a944c0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:11.514941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-8926ca26-3980-48e7-97b9-9d8a5ba2adf8 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] HTTP exception thrown: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8926ca26-3980-48e7-97b9-9d8a5ba2adf8 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Request method failure captured: Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c HTTP/1.1 Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6xjGa8yzLiefsnksbph44cI4Q4qm3lemKfWP9xHWUTKQMyoKgyvpb-sg0BMOZ2ZrBzXX2xzecFsCQrOYkuPFmZsdmVJ4O7ySTXpmlXweP5oifAOAQetPObypzMp9p9hmbiiGyWPHEtL_hsotych_oz0_HALWKKIz9OuRW972cSPn0w Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:24:11.519786 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: dc49853bd7f94f8e915835c465f6fc20 Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '417adbb1-6ac3-45be-a7c4-21d967d83d2c'} Sep 06 20:24:11.521514 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. (HTTP 404) (Request-ID: req-689fd64a-2db0-48bd-a04d-23bd0f4bfc8a) Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.522639 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:11.524034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 20:24:11.525241 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8926ca26-3980-48e7-97b9-9d8a5ba2adf8 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Returning 404 to user: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8926ca26-3980-48e7-97b9-9d8a5ba2adf8 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c" status: 404 len: 109 microversion: 2.1 time: 0.070433 Sep 06 20:24:11.526475 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 596/1150] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:11 2022] GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:11.540094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3fdb7e18-7b8a-450c-8801-5b38d9e270f7 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c3b916ca0>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:11.572442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-3fdb7e18-7b8a-450c-8801-5b38d9e270f7 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] HTTP exception thrown: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3fdb7e18-7b8a-450c-8801-5b38d9e270f7 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Request method failure captured: Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c HTTP/1.1 Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6xjGa8yzLiefsnksbph44cI4Q4qm3lemKfWP9xHWUTKQMyoKgyvpb-sg0BMOZ2ZrBzXX2xzecFsCQrOYkuPFmZsdmVJ4O7ySTXpmlXweP5oifAOAQetPObypzMp9p9hmbiiGyWPHEtL_hsotych_oz0_HALWKKIz9OuRW972cSPn0w Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:11.574833 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: dc49853bd7f94f8e915835c465f6fc20 Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '417adbb1-6ac3-45be-a7c4-21d967d83d2c'} Sep 06 20:24:11.576523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. (HTTP 404) (Request-ID: req-1372b090-03b1-4108-aae0-4dc6c7f30388) Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.577562 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 20:24:11.578942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 20:24:11.580361 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3fdb7e18-7b8a-450c-8801-5b38d9e270f7 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Returning 404 to user: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:11.582484 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3fdb7e18-7b8a-450c-8801-5b38d9e270f7 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c" status: 404 len: 109 microversion: 2.1 time: 0.045405 Sep 06 20:24:11.583590 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 555/1151] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:24:11 2022] DELETE /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:11.589210 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2c652cba-f105-48c1-9050-efe58f9ea2f6 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Calling method '.version_select at 0x7f9c37a94790>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:11.623625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-2c652cba-f105-48c1-9050-efe58f9ea2f6 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] HTTP exception thrown: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2c652cba-f105-48c1-9050-efe58f9ea2f6 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Request method failure captured: Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c HTTP/1.1 Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6xjGa8yzLiefsnksbph44cI4Q4qm3lemKfWP9xHWUTKQMyoKgyvpb-sg0BMOZ2ZrBzXX2xzecFsCQrOYkuPFmZsdmVJ4O7ySTXpmlXweP5oifAOAQetPObypzMp9p9hmbiiGyWPHEtL_hsotych_oz0_HALWKKIz9OuRW972cSPn0w Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:24:11.626223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/121f31a3391b43948e3eeec3f2332dd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 121f31a3391b43948e3eeec3f2332dd1 Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1895414809 Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: dc49853bd7f94f8e915835c465f6fc20 Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1895414809-project Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '417adbb1-6ac3-45be-a7c4-21d967d83d2c'} Sep 06 20:24:11.630570 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. (HTTP 404) (Request-ID: req-1c047fb9-7795-45fb-8b44-b7e168b284c8) Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.631668 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:11.633029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 20:24:11.635488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2c652cba-f105-48c1-9050-efe58f9ea2f6 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] Returning 404 to user: Volume 417adbb1-6ac3-45be-a7c4-21d967d83d2c could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2c652cba-f105-48c1-9050-efe58f9ea2f6 tempest-VolumesSnapshotsTestJSON-1895414809 tempest-VolumesSnapshotsTestJSON-1895414809-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c" status: 404 len: 109 microversion: 2.1 time: 0.043160 Sep 06 20:24:11.636740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 597/1152] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:11 2022] GET /compute/v2.1/os-volumes/417adbb1-6ac3-45be-a7c4-21d967d83d2c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:14.288568 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-223fc23d-21bc-4707-976b-0b0df66495f5 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Action: 'create', calling method: .version_select at 0x7f9c3bb211f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-913597781", "metadata": {"Type": "work"}}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:14.762022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-223fc23d-21bc-4707-976b-0b0df66495f5 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.677777 Sep 06 20:24:14.763108 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 556/1153] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 20:24:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 680 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 20:24:14.788828 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-98c8dfa5-bbf4-4438-b774-0cf92267d835 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Calling method '.version_select at 0x7f9c37a87b80>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:14.811626 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=62 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:14.814326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=1 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:14.900277 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-98c8dfa5-bbf4-4438-b774-0cf92267d835 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b" status: 200 len: 352 microversion: 2.1 time: 0.121382 Sep 06 20:24:14.901165 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 598/1154] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:14 2022] GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:15.926328 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d84415b4-4a31-4e7e-8969-4cb25d9f1b7b tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Calling method '.version_select at 0x7f9c3bcf3d30>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:15.988944 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d84415b4-4a31-4e7e-8969-4cb25d9f1b7b tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b" status: 200 len: 353 microversion: 2.1 time: 0.071615 Sep 06 20:24:15.990138 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 557/1155] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:15 2022] GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:16.010145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9e2c151d-c9f0-43c9-8bab-bc96327cd6af tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Calling method '.version_select at 0x7f9c37b80820>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:16.104005 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9e2c151d-c9f0-43c9-8bab-bc96327cd6af tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b" status: 200 len: 353 microversion: 2.1 time: 0.101425 Sep 06 20:24:16.105518 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 599/1156] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:16 2022] GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:16.137449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0822ba0e-98de-44bb-80fc-439840930373 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Calling method '.version_select at 0x7f9c3bcf3280>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:16.213072 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0822ba0e-98de-44bb-80fc-439840930373 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b" status: 202 len: 0 microversion: 2.1 time: 0.080617 Sep 06 20:24:16.214160 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 558/1157] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:24:16 2022] DELETE /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 20:24:16.226141 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-26693dc9-e0ca-40cb-9b6b-f0688dae7478 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Calling method '.version_select at 0x7f9c37b89040>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:16.316488 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-26693dc9-e0ca-40cb-9b6b-f0688dae7478 tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b" status: 200 len: 352 microversion: 2.1 time: 0.096550 Sep 06 20:24:16.317913 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 600/1158] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:16 2022] GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:17.339378 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-401427d3-d1e3-4a29-baf2-917f86b13b0b tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Calling method '.version_select at 0x7f9c3bce5820>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:17.383922 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-401427d3-d1e3-4a29-baf2-917f86b13b0b tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] HTTP exception thrown: Volume 521eeb72-e94f-4f44-adcb-85ac49095d7b could not be found. Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-401427d3-d1e3-4a29-baf2-917f86b13b0b tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Request method failure captured: Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b HTTP/1.1 Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6xtcqE8YCxecaaJ9Gl1xswJH57GKO9Xt_D1N7voky_UMsDnQx84TeI8MiAxAEafuA3g8tAuAUJ7sySF42v3NWnC5w-9hKOBRVxjIZuVKGmmgGT9tpz-VqOQOv6Muxht4VKJkVIgzJFT6RtpLHX6jeJPs0xZgoX8Fmibmf55-wbfqLo Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 41416e1465f541b6b41f2086f750f8ef Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-VolumesGetTestJSON-1747244110 Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:17.387201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41416e1465f541b6b41f2086f750f8ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_41416e1465f541b6b41f2086f750f8ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/41416e1465f541b6b41f2086f750f8ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/41416e1465f541b6b41f2086f750f8ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-VolumesGetTestJSON-1747244110 Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 41416e1465f541b6b41f2086f750f8ef Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-VolumesGetTestJSON-1747244110 Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-VolumesGetTestJSON-1747244110-project Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 8493c3f84ba34cd1800e08189f91f619 Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-VolumesGetTestJSON-1747244110-project Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Volume 521eeb72-e94f-4f44-adcb-85ac49095d7b could not be found. Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '521eeb72-e94f-4f44-adcb-85ac49095d7b'} Sep 06 20:24:17.389589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 521eeb72-e94f-4f44-adcb-85ac49095d7b could not be found. (HTTP 404) (Request-ID: req-c1a0cbf0-ddd4-400a-8e2f-8abb94b1ab52) Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:17.391376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:17.393321 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 521eeb72-e94f-4f44-adcb-85ac49095d7b could not be found. Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 20:24:17.396254 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 521eeb72-e94f-4f44-adcb-85ac49095d7b could not be found. Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 521eeb72-e94f-4f44-adcb-85ac49095d7b could not be found. Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-401427d3-d1e3-4a29-baf2-917f86b13b0b tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] Returning 404 to user: Volume 521eeb72-e94f-4f44-adcb-85ac49095d7b could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-401427d3-d1e3-4a29-baf2-917f86b13b0b tempest-VolumesGetTestJSON-1747244110 tempest-VolumesGetTestJSON-1747244110-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b" status: 404 len: 109 microversion: 2.1 time: 0.056322 Sep 06 20:24:17.400250 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 559/1159] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:17 2022] GET /compute/v2.1/os-volumes/521eeb72-e94f-4f44-adcb-85ac49095d7b => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:20.203748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:20.208739 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:20.219606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:20.220138 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:20.220583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:20.221532 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:20.221820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:20.222672 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:20.257146 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c77cc86c-2e90-4f77-add2-ddf5337153b6 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062267 Sep 06 20:24:20.257760 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 601/1160] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 6 20:24:20 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:24:20.361162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:20.361818 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:20.372171 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:20.372936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:20.373532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:20.374539 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:20.375081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:20.375801 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:20.418614 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:24:20.515042 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bbb58a58-6889-4570-a8d6-2e26cf290bef tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 204 len: 0 microversion: 2.20 time: 0.158781 Sep 06 20:24:20.515662 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 560/1161] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 20:24:20 2022] DELETE /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 20:24:20.543026 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:20.544487 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:20.554933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:20.556051 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:20.557035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:20.558271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:20.558858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:20.559443 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:20.737573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:20.755740 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:20.759447 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:20.762234 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ec261f68-7004-498e-9d5c-c916e4d121c9 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.229167 Sep 06 20:24:20.763075 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 602/1162] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:24:20 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:24:21.796231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:21.797813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:21.811077 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:21.812093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:21.813013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:21.815204 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:21.816301 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:21.817733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:22.448837 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:22.478508 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:22.486213 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:22.488368 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bb27a384-4953-4673-a619-597b4bf6a1bb tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1722 microversion: 2.20 time: 0.701022 Sep 06 20:24:22.489901 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 561/1163] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:24:21 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1722 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 20:24:23.516933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:23.518354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:23.528984 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:23.529687 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:23.530356 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:23.531336 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:23.531941 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:23.532619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:23.696283 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:23.707132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:23.708834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:23.710565 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f0d252bd-0c74-4673-8d07-b0d77eb3c024 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1654 microversion: 2.20 time: 0.197990 Sep 06 20:24:23.715761 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 603/1164] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:24:23 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1654 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:24:24.573439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-059d21cc-310f-4110-8cf9-0f60376b0912 req-2dc3b3eb-2c33-4ad4-b3ce-8af9e3dfdbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53ac635-8d07-41f0-97d5-f0e81e70b51b", "name": "network-vif-deleted", "tag": "26463c3c-fa68-45c1-9baa-cb0cf6ff34ec"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:24.610320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-059d21cc-310f-4110-8cf9-0f60376b0912 req-2dc3b3eb-2c33-4ad4-b3ce-8af9e3dfdbd1 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:24.611277 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-059d21cc-310f-4110-8cf9-0f60376b0912 req-2dc3b3eb-2c33-4ad4-b3ce-8af9e3dfdbd1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:24.612237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-059d21cc-310f-4110-8cf9-0f60376b0912 req-2dc3b3eb-2c33-4ad4-b3ce-8af9e3dfdbd1 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:24.645070 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-059d21cc-310f-4110-8cf9-0f60376b0912 req-2dc3b3eb-2c33-4ad4-b3ce-8af9e3dfdbd1 service nova] Creating event network-vif-deleted:26463c3c-fa68-45c1-9baa-cb0cf6ff34ec for instance a53ac635-8d07-41f0-97d5-f0e81e70b51b on hv-cinder-84773 Sep 06 20:24:24.653343 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-059d21cc-310f-4110-8cf9-0f60376b0912 req-2dc3b3eb-2c33-4ad4-b3ce-8af9e3dfdbd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088309 Sep 06 20:24:24.655128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 562/1165] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:24.761555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:24.768685 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:24.782105 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:24.784022 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:24.785792 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:24.787503 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:24.789178 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:24.790212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:24.876372 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:24.877440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:24.878626 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:24.879476 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lazy-loading 'fault' on Instance uuid a53ac635-8d07-41f0-97d5-f0e81e70b51b {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:24:25.002902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:25.020320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:25.025393 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7be957f2c15c4f6f949b3f284a30624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0bdb5e8899b4766b797688ad00c7ce0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:25.028624 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ebb9e90f-7ec8-44fb-b157-a7275812f829 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 200 len: 1370 microversion: 2.20 time: 0.274758 Sep 06 20:24:25.030550 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 604/1166] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:24:24 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 20:24:26.089425 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:26.091897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:26.115904 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:26.116774 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:26.117657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:26.118955 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:26.119843 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:26.120589 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:26.148367 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] HTTP exception thrown: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Request method failure captured: Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b HTTP/1.1 Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6peVt_ERWMvj63kiV2hwj5u9lcUXUlN3s0GMpw3DA0SZfOjPQSm58BR7pxnrlv2oIfZzp0qyLcuiOkbjq2ZFTYBLNak96kVD-GlphfcCq-XE_gRzudNNyLvfd5LxdQzj2eb7yhkMZkQmofKsB5dSS1P2DorpSCV5IX3FwRlDh9_TsQ Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:26.151613 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 7be957f2c15c4f6f949b3f284a30624d Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:26.153857 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'a53ac635-8d07-41f0-97d5-f0e81e70b51b'} Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:26.155653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:26.158172 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:26.162094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Returning 404 to user: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:26.162094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-108c121c-f3c1-4284-8664-7af05a64cfa4 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 404 len: 111 microversion: 2.20 time: 0.074794 Sep 06 20:24:26.162094 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 563/1167] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:24:26 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 20:24:26.170535 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d070216f-0a76-480f-afb5-2808fa99d026 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '.version_select at 0x7f9c37a87940>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:26.217678 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d070216f-0a76-480f-afb5-2808fa99d026 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980359669" status: 204 len: 0 microversion: 2.20 time: 0.054294 Sep 06 20:24:26.218751 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 605/1168] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Sep 6 20:24:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980359669 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 20:24:28.675852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:28.676744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:28.684936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:28.685437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:28.685944 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:28.686748 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:28.687485 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:28.688002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:28.710269 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] HTTP exception thrown: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Request method failure captured: Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b HTTP/1.1 Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6peVt_ERWMvj63kiV2hwj5u9lcUXUlN3s0GMpw3DA0SZfOjPQSm58BR7pxnrlv2oIfZzp0qyLcuiOkbjq2ZFTYBLNak96kVD-GlphfcCq-XE_gRzudNNyLvfd5LxdQzj2eb7yhkMZkQmofKsB5dSS1P2DorpSCV5IX3FwRlDh9_TsQ Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:28.713279 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 7be957f2c15c4f6f949b3f284a30624d Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.715969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'a53ac635-8d07-41f0-97d5-f0e81e70b51b'} Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:28.718101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.720163 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.723418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Returning 404 to user: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:28.723418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-8591939d-15e6-4697-a5c5-ee2a0b533899 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 404 len: 111 microversion: 2.20 time: 0.045358 Sep 06 20:24:28.723418 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 564/1169] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 20:24:28 2022] DELETE /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 20:24:28.729560 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:28.730583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: a53ac635-8d07-41f0-97d5-f0e81e70b51b] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:28.741496 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:28.742213 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:28.742748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:28.743578 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:28.744737 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:28.745313 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:28.767071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] HTTP exception thrown: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Request method failure captured: Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b HTTP/1.1 Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6peVt_ERWMvj63kiV2hwj5u9lcUXUlN3s0GMpw3DA0SZfOjPQSm58BR7pxnrlv2oIfZzp0qyLcuiOkbjq2ZFTYBLNak96kVD-GlphfcCq-XE_gRzudNNyLvfd5LxdQzj2eb7yhkMZkQmofKsB5dSS1P2DorpSCV5IX3FwRlDh9_TsQ Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:24:28.769498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 7be957f2c15c4f6f949b3f284a30624d Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.773164 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'a53ac635-8d07-41f0-97d5-f0e81e70b51b'} Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:28.775093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. Sep 06 20:24:28.778218 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:28.780618 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Returning 404 to user: Instance a53ac635-8d07-41f0-97d5-f0e81e70b51b could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:28.780618 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b9e2eddf-7669-4fe0-b982-d9f3d79f0cb8 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b" status: 404 len: 111 microversion: 2.20 time: 0.048914 Sep 06 20:24:28.780618 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 606/1170] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:24:28 2022] GET /compute/v2.1/servers/a53ac635-8d07-41f0-97d5-f0e81e70b51b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 20:24:30.043503 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:30.044385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:30.057203 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:30.058081 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:30.058854 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:30.060550 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:30.061355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:30.062659 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:30.100766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] HTTP exception thrown: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Request method failure captured: Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 HTTP/1.1 Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6peVt_ERWMvj63kiV2hwj5u9lcUXUlN3s0GMpw3DA0SZfOjPQSm58BR7pxnrlv2oIfZzp0qyLcuiOkbjq2ZFTYBLNak96kVD-GlphfcCq-XE_gRzudNNyLvfd5LxdQzj2eb7yhkMZkQmofKsB5dSS1P2DorpSCV5IX3FwRlDh9_TsQ Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:30.106355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 7be957f2c15c4f6f949b3f284a30624d Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.108948 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'c0f6b5ee-95cf-4e73-8124-578bcbcd7c19'} Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:30.110436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.113446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.115135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Returning 404 to user: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:30.115135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ae04a8bd-89dc-476c-98fb-520d340b522f tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 404 len: 111 microversion: 2.20 time: 0.073694 Sep 06 20:24:30.115135 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 565/1171] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 6 20:24:30 2022] DELETE /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 20:24:30.126749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:30.130334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] [instance: c0f6b5ee-95cf-4e73-8124-578bcbcd7c19] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:30.141275 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:30.142196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:30.144466 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:30.152713 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:30.154388 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:30.155061 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:30.194852 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] HTTP exception thrown: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Request method failure captured: Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 HTTP/1.1 Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6peVt_ERWMvj63kiV2hwj5u9lcUXUlN3s0GMpw3DA0SZfOjPQSm58BR7pxnrlv2oIfZzp0qyLcuiOkbjq2ZFTYBLNak96kVD-GlphfcCq-XE_gRzudNNyLvfd5LxdQzj2eb7yhkMZkQmofKsB5dSS1P2DorpSCV5IX3FwRlDh9_TsQ Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:24:30.196673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d0bdb5e8899b4766b797688ad00c7ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: d0bdb5e8899b4766b797688ad00c7ce0 Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1231358663 Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 7be957f2c15c4f6f949b3f284a30624d Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1231358663-project Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.198590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'c0f6b5ee-95cf-4e73-8124-578bcbcd7c19'} Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:30.199559 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. Sep 06 20:24:30.201468 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:30.204226 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] Returning 404 to user: Instance c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:30.205832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4335f4bb-acdf-48b4-8604-74cf3ca99266 tempest-AttachVolumeShelveTestJSON-1231358663 tempest-AttachVolumeShelveTestJSON-1231358663-project] 10.222.0.20 "GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19" status: 404 len: 111 microversion: 2.20 time: 0.086643 Sep 06 20:24:30.206947 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 607/1172] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 6 20:24:30 2022] GET /compute/v2.1/servers/c0f6b5ee-95cf-4e73-8124-578bcbcd7c19 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 20:24:32.454943 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:32.455786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:32.473436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:32.473436 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:32.473816 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:32.474277 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:32.477243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:32.478002 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:32.484314 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-0a915518-7d42-4c30-a3ff-bfbece0e6f30 req-6c0503d9-b93b-4531-b68b-86d10b487855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d46c6a-bba3-4e7e-ab96-f22796eee28e", "tag": "58da1786-9578-4fdc-816f-0dacca3e7184"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:32.514140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0a915518-7d42-4c30-a3ff-bfbece0e6f30 req-6c0503d9-b93b-4531-b68b-86d10b487855 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:32.515589 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0a915518-7d42-4c30-a3ff-bfbece0e6f30 req-6c0503d9-b93b-4531-b68b-86d10b487855 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:32.516619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-0a915518-7d42-4c30-a3ff-bfbece0e6f30 req-6c0503d9-b93b-4531-b68b-86d10b487855 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:32.537851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:24:32.557154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-0a915518-7d42-4c30-a3ff-bfbece0e6f30 req-6c0503d9-b93b-4531-b68b-86d10b487855 service nova] Creating event network-changed:58da1786-9578-4fdc-816f-0dacca3e7184 for instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e on hv-cinder-84773 Sep 06 20:24:32.571817 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-0a915518-7d42-4c30-a3ff-bfbece0e6f30 req-6c0503d9-b93b-4531-b68b-86d10b487855 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100635 Sep 06 20:24:32.573265 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 608/1173] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:24:32.850567 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2243ad3e-6e53-4247-94ce-4dd028d85704 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "DELETE /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 204 len: 0 microversion: 2.1 time: 0.398767 Sep 06 20:24:32.853596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 566/1174] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:24:32 2022] DELETE /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:24:32.865489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:32.866406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:32.874244 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:32.875161 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:32.875845 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:32.876888 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:32.877861 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:32.878633 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:33.358246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:33.374967 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a61fe291-8523-4f62-8b61-bc6881710747 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.514275 Sep 06 20:24:33.377370 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 609/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:32 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:24:34.404551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:34.405733 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:34.431476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:34.432111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:34.432570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:34.433338 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:34.434111 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:34.437809 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:35.160824 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:35.175695 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ddd14366-87b3-432b-be7e-d70696ef6c73 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1566 microversion: 2.1 time: 0.775399 Sep 06 20:24:35.179968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 567/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:34 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1566 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:24:36.210034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:36.213288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:36.228242 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:36.229121 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:36.229667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:36.230622 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:36.231117 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:36.231556 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:36.336746 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:36.350185 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-69e14bb2-6a5c-45fe-8139-9090fde4ffb8 tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1381 microversion: 2.1 time: 0.146244 Sep 06 20:24:36.351743 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 610/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:36 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1381 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:24:36.546579 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-066ac037-ea2f-4593-842f-a017f90629b9 req-81bdf30d-480d-4733-9ae8-718b9517af26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d46c6a-bba3-4e7e-ab96-f22796eee28e", "name": "network-vif-deleted", "tag": "58da1786-9578-4fdc-816f-0dacca3e7184"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:36.571753 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-066ac037-ea2f-4593-842f-a017f90629b9 req-81bdf30d-480d-4733-9ae8-718b9517af26 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:36.574013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-066ac037-ea2f-4593-842f-a017f90629b9 req-81bdf30d-480d-4733-9ae8-718b9517af26 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:36.575099 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-066ac037-ea2f-4593-842f-a017f90629b9 req-81bdf30d-480d-4733-9ae8-718b9517af26 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:36.596856 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-066ac037-ea2f-4593-842f-a017f90629b9 req-81bdf30d-480d-4733-9ae8-718b9517af26 service nova] Creating event network-vif-deleted:58da1786-9578-4fdc-816f-0dacca3e7184 for instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e on hv-cinder-84773 Sep 06 20:24:36.606594 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-066ac037-ea2f-4593-842f-a017f90629b9 req-81bdf30d-480d-4733-9ae8-718b9517af26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068307 Sep 06 20:24:36.607777 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 568/1178] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:24:37.385158 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:37.387066 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:37.418918 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:37.420777 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:37.423319 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:37.427079 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:37.428698 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:37.430572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:37.550691 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa686e692444eae835ca343926e0595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b030ea0d617b4583a2397921c884aaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:37.566063 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-238a9c9a-8155-4730-ba04-6b6fd842df7a tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 200 len: 1218 microversion: 2.1 time: 0.189230 Sep 06 20:24:37.567720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 611/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:37 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:24:38.605126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:38.607419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] [instance: 85d46c6a-bba3-4e7e-ab96-f22796eee28e] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:38.618763 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:38.619664 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:38.620329 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:38.621783 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:38.623716 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:38.624462 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:38.664173 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] HTTP exception thrown: Instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e could not be found. Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Request method failure captured: Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e HTTP/1.1 Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6sEquvX8fWKTfLSHGOrhTJ-LjEowwJho1J_51SdNEDosTSk-y2J3gzoKPi_yBnTbEB_-Wb_Rh3mYLGYDz8yhCK7K4NZCotRIr7Qv1DEgU-3B0UPz-1Qq_gPyQkSHrxmeCP-kKcv5ybQ4LtmxKbbt1KfvAmK_yqAypIYar2wW2DGp2E Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: b030ea0d617b4583a2397921c884aaa5 Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-TestShelveInstance-225148237 Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:38.667446 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b030ea0d617b4583a2397921c884aaa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b030ea0d617b4583a2397921c884aaa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b030ea0d617b4583a2397921c884aaa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b030ea0d617b4583a2397921c884aaa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-TestShelveInstance-225148237 Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: b030ea0d617b4583a2397921c884aaa5 Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-TestShelveInstance-225148237 Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-TestShelveInstance-225148237-project Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: aaa686e692444eae835ca343926e0595 Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-TestShelveInstance-225148237-project Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e could not be found. Sep 06 20:24:38.670234 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '85d46c6a-bba3-4e7e-ab96-f22796eee28e'} Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e could not be found. Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:38.671731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e could not be found. Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e could not be found. Sep 06 20:24:38.673495 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:38.678603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Returning 404 to user: Instance 85d46c6a-bba3-4e7e-ab96-f22796eee28e could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:38.678603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-188e12fe-8dc3-4bed-8175-209db2c80c0d tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e" status: 404 len: 111 microversion: 2.1 time: 0.074635 Sep 06 20:24:38.678603 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 569/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:38 2022] GET /compute/v2.1/servers/85d46c6a-bba3-4e7e-ab96-f22796eee28e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:39.035280 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-26327104-4c1b-488f-b6b5-2d23f2b8834f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] Calling method '.version_select at 0x7f9c37ab5670>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:39.102734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-26327104-4c1b-488f-b6b5-2d23f2b8834f tempest-TestShelveInstance-225148237 tempest-TestShelveInstance-225148237-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-384168834" status: 202 len: 0 microversion: 2.1 time: 0.093449 Sep 06 20:24:39.109492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 612/1181] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 6 20:24:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-384168834 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 20:24:40.125644 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a9eb5942-436e-4a76-862f-57248483a436 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Action: 'create', calling method: .version_select at 0x7f9c3f2c2b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-730832342", "metadata": {"Type": "work"}}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a9eb5942-436e-4a76-862f-57248483a436 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Request method failure captured: Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 121 Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6yHFOOb1TzLr2KNxCSBXi-ut1AG_HUeE8pUIvJUHuyYhryZouXT8jWpy4Ir9UV5rfdXKECXNgRWVcuKrGnPEDO61ee-9neVCDuFw1-oLLFJu0EJD1gQ591qrJL3oMQvOavBXD_3lSZ6MHdtZy9g7ux4Qbec0xoYimj3nCG2CM4hHdg Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:40.154387 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 676f6109261c4b02901003c9399e2c88 Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-730832342", "metadata": {"Type": "work"}}} Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: Sep 06 20:24:40.156285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-730832342', 'metadata': {'Type': 'work'}}}} Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise error Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:40.157519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 20:24:40.160771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 20:24:40.163404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 20:24:40.163404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.163404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a9eb5942-436e-4a76-862f-57248483a436 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:40.163404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a9eb5942-436e-4a76-862f-57248483a436 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.219524 Sep 06 20:24:40.163404 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 570/1182] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 20:24:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 20:24:40.170456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ddc993d9-fdf4-4c53-b552-8cda2ef2f085 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Action: 'create', calling method: .version_select at 0x7f9c37b6edc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-938496167", "metadata": {"Type": "work"}}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ddc993d9-fdf4-4c53-b552-8cda2ef2f085 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Request method failure captured: Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 119 Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6yHFOOb1TzLr2KNxCSBXi-ut1AG_HUeE8pUIvJUHuyYhryZouXT8jWpy4Ir9UV5rfdXKECXNgRWVcuKrGnPEDO61ee-9neVCDuFw1-oLLFJu0EJD1gQ591qrJL3oMQvOavBXD_3lSZ6MHdtZy9g7ux4Qbec0xoYimj3nCG2CM4hHdg Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:24:40.176692 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 676f6109261c4b02901003c9399e2c88 Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-938496167", "metadata": {"Type": "work"}}} Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: Sep 06 20:24:40.179921 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-938496167', 'metadata': {'Type': 'work'}}}} Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise error Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi '0' Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:40.182960 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 20:24:40.187132 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 20:24:40.192207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 20:24:40.192207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.192207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-ddc993d9-fdf4-4c53-b552-8cda2ef2f085 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:40.192207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-ddc993d9-fdf4-4c53-b552-8cda2ef2f085 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014791 Sep 06 20:24:40.192207 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 613/1183] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 20:24:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 20:24:40.196323 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3a98f326-167a-44c7-86f5-47e754c7195a tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Action: 'create', calling method: .version_select at 0x7f9c3bb3b0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1840359761", "metadata": {"Type": "work"}}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3a98f326-167a-44c7-86f5-47e754c7195a tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Request method failure captured: Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 119 Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6yHFOOb1TzLr2KNxCSBXi-ut1AG_HUeE8pUIvJUHuyYhryZouXT8jWpy4Ir9UV5rfdXKECXNgRWVcuKrGnPEDO61ee-9neVCDuFw1-oLLFJu0EJD1gQ591qrJL3oMQvOavBXD_3lSZ6MHdtZy9g7ux4Qbec0xoYimj3nCG2CM4hHdg Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:40.200615 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 676f6109261c4b02901003c9399e2c88 Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1840359761", "metadata": {"Type": "work"}}} Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: Sep 06 20:24:40.204082 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1840359761', 'metadata': {'Type': 'work'}}}} Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise error Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi '' Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:40.206177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 20:24:40.211140 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 20:24:40.214109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 20:24:40.214109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.214109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3a98f326-167a-44c7-86f5-47e754c7195a tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:40.214109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3a98f326-167a-44c7-86f5-47e754c7195a tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011987 Sep 06 20:24:40.214109 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 571/1184] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 6 20:24:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 20:24:40.221926 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db1b7bdc-48b1-4462-9e79-3822e6d85a39 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Calling method '.version_select at 0x7f9c37b6e310>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:40.255456 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-db1b7bdc-48b1-4462-9e79-3822e6d85a39 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] HTTP exception thrown: Volume tempest-invalid-46342129 could not be found. Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db1b7bdc-48b1-4462-9e79-3822e6d85a39 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Request method failure captured: Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-46342129 HTTP/1.1 Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6yHFOOb1TzLr2KNxCSBXi-ut1AG_HUeE8pUIvJUHuyYhryZouXT8jWpy4Ir9UV5rfdXKECXNgRWVcuKrGnPEDO61ee-9neVCDuFw1-oLLFJu0EJD1gQ591qrJL3oMQvOavBXD_3lSZ6MHdtZy9g7ux4Qbec0xoYimj3nCG2CM4hHdg Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:24:40.259506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 676f6109261c4b02901003c9399e2c88 Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Volume tempest-invalid-46342129 could not be found. Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'tempest-invalid-46342129'} Sep 06 20:24:40.261229 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-46342129 could not be found. (HTTP 404) (Request-ID: req-0d995de2-766c-40d7-b594-ce8b14489a0c) Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.262246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 20:24:40.265813 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-46342129 could not be found. Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:40.270682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-46342129 could not be found. Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-46342129 could not be found. Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-db1b7bdc-48b1-4462-9e79-3822e6d85a39 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Returning 404 to user: Volume tempest-invalid-46342129 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-db1b7bdc-48b1-4462-9e79-3822e6d85a39 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-46342129" status: 404 len: 97 microversion: 2.1 time: 0.049700 Sep 06 20:24:40.273407 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 614/1185] 10.222.0.20 () {58 vars in 1212 bytes} [Tue Sep 6 20:24:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-46342129 => generated 97 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 20:24:40.276474 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-93cd8ffb-c1d5-456d-a939-74068f7754c8 tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004478 Sep 06 20:24:40.286943 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 572/1186] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 6 20:24:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 20:24:40.290720 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1228b845-4e60-471b-aa25-14e8936c51de tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006866 Sep 06 20:24:40.291654 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 615/1187] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Sep 6 20:24:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 20:24:40.301661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7ba36b55-7c7a-4eba-8761-d8d3c22ba21d tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Calling method '.version_select at 0x7f9c3bac5d30>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:40.358071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-7ba36b55-7c7a-4eba-8761-d8d3c22ba21d tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] HTTP exception thrown: Volume b4afe5eb-e844-4509-975a-3143dac43d2b could not be found. Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7ba36b55-7c7a-4eba-8761-d8d3c22ba21d tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Request method failure captured: Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: DELETE /compute/v2.1/os-volumes/b4afe5eb-e844-4509-975a-3143dac43d2b HTTP/1.1 Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6yHFOOb1TzLr2KNxCSBXi-ut1AG_HUeE8pUIvJUHuyYhryZouXT8jWpy4Ir9UV5rfdXKECXNgRWVcuKrGnPEDO61ee-9neVCDuFw1-oLLFJu0EJD1gQ591qrJL3oMQvOavBXD_3lSZ6MHdtZy9g7ux4Qbec0xoYimj3nCG2CM4hHdg Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:24:40.364670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 676f6109261c4b02901003c9399e2c88 Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Volume b4afe5eb-e844-4509-975a-3143dac43d2b could not be found. Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'b4afe5eb-e844-4509-975a-3143dac43d2b'} Sep 06 20:24:40.366398 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4afe5eb-e844-4509-975a-3143dac43d2b could not be found. (HTTP 404) (Request-ID: req-94225dcf-3aa4-4958-9298-651917544a6c) Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.367419 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 20:24:40.369101 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4afe5eb-e844-4509-975a-3143dac43d2b could not be found. Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 20:24:40.370661 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4afe5eb-e844-4509-975a-3143dac43d2b could not be found. Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4afe5eb-e844-4509-975a-3143dac43d2b could not be found. Sep 06 20:24:40.372144 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.375385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7ba36b55-7c7a-4eba-8761-d8d3c22ba21d tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Returning 404 to user: Volume b4afe5eb-e844-4509-975a-3143dac43d2b could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:40.383602 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7ba36b55-7c7a-4eba-8761-d8d3c22ba21d tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b4afe5eb-e844-4509-975a-3143dac43d2b" status: 404 len: 109 microversion: 2.1 time: 0.078155 Sep 06 20:24:40.385355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 573/1188] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 6 20:24:40 2022] DELETE /compute/v2.1/os-volumes/b4afe5eb-e844-4509-975a-3143dac43d2b => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:40.395784 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3d1f6d67-da87-45a1-8005-eb8ec5f9adbd tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Calling method '.version_select at 0x7f9c37c49040>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:40.429126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-3d1f6d67-da87-45a1-8005-eb8ec5f9adbd tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] HTTP exception thrown: Volume 110d8cd9-13a7-436c-a61e-cea4e7a21522 could not be found. Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3d1f6d67-da87-45a1-8005-eb8ec5f9adbd tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Request method failure captured: Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/os-volumes/110d8cd9-13a7-436c-a61e-cea4e7a21522 HTTP/1.1 Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6yHFOOb1TzLr2KNxCSBXi-ut1AG_HUeE8pUIvJUHuyYhryZouXT8jWpy4Ir9UV5rfdXKECXNgRWVcuKrGnPEDO61ee-9neVCDuFw1-oLLFJu0EJD1gQ591qrJL3oMQvOavBXD_3lSZ6MHdtZy9g7ux4Qbec0xoYimj3nCG2CM4hHdg Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:24:40.431385 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b2546fb97eb4db083c5e90af38aa355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 0b2546fb97eb4db083c5e90af38aa355 Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesNegativeTest-1841303102 Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 676f6109261c4b02901003c9399e2c88 Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesNegativeTest-1841303102-project Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Volume 110d8cd9-13a7-436c-a61e-cea4e7a21522 could not be found. Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '110d8cd9-13a7-436c-a61e-cea4e7a21522'} Sep 06 20:24:40.433137 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 110d8cd9-13a7-436c-a61e-cea4e7a21522 could not be found. (HTTP 404) (Request-ID: req-26a9949c-fc10-4958-acbc-aeee4a3cc231) Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.434135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 20:24:40.435875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 110d8cd9-13a7-436c-a61e-cea4e7a21522 could not be found. Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 20:24:40.437246 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 110d8cd9-13a7-436c-a61e-cea4e7a21522 could not be found. Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 110d8cd9-13a7-436c-a61e-cea4e7a21522 could not be found. Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3d1f6d67-da87-45a1-8005-eb8ec5f9adbd tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] Returning 404 to user: Volume 110d8cd9-13a7-436c-a61e-cea4e7a21522 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3d1f6d67-da87-45a1-8005-eb8ec5f9adbd tempest-VolumesNegativeTest-1841303102 tempest-VolumesNegativeTest-1841303102-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/110d8cd9-13a7-436c-a61e-cea4e7a21522" status: 404 len: 109 microversion: 2.1 time: 0.042507 Sep 06 20:24:40.438763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 616/1189] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 6 20:24:40 2022] GET /compute/v2.1/os-volumes/110d8cd9-13a7-436c-a61e-cea4e7a21522 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:24:56.699112 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:56.700394 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:56.705206 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1353635770", "imageRef": "63035568-be20-4ce3-9676-c3dbf78966b7", "flavorRef": "452"}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:24:56.788067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] validate_networks() for None {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:24:57.481381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:24:57.481848 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:24:57.482324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:24:57.482727 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:24:57.483130 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:24:57.493800 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:57.494625 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:57.495260 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:57.496237 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:57.496900 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:57.497550 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:57.522264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Getting quotas for project 7709cf0cbdb5418d92f698a66780e61f. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:24:57.528536 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Getting quotas for user 1a7236719669467383c242d0f5a91604 and project 7709cf0cbdb5418d92f698a66780e61f. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:24:57.545139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:24:57.548732 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63035568-be20-4ce3-9676-c3dbf78966b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:24:57.638926 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ee60c43a-b240-4b7f-ab74-4487fc67c771 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943183 Sep 06 20:24:57.641063 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 574/1190] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 20:24:57.659045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-506d073e-f42d-4a7e-9e8d-b0f18556de01 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:57.659926 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-506d073e-f42d-4a7e-9e8d-b0f18556de01 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:57.662667 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=50 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:57.663408 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:57.767034 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-506d073e-f42d-4a7e-9e8d-b0f18556de01 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:57.778703 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-506d073e-f42d-4a7e-9e8d-b0f18556de01 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1215 microversion: 2.1 time: 0.123936 Sep 06 20:24:57.779902 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 617/1191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:57 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:24:58.809500 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:58.811672 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:58.823811 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:58.824709 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:58.825489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:58.827071 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:58.827926 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:58.828703 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:58.924416 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:24:58.934639 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4f6cb408-aa15-4899-835e-221becd14e34 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1211 microversion: 2.1 time: 0.133640 Sep 06 20:24:58.935688 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 575/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:58 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1211 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:24:59.969694 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:24:59.970880 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:24:59.989558 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:59.990418 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:59.991212 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:24:59.993928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:24:59.995017 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:24:59.996334 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:00.143278 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:00.162326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3910f7af-774d-48cc-9945-f858cb0ab9e3 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1285 microversion: 2.1 time: 0.203053 Sep 06 20:25:00.164412 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 618/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:24:59 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:01.215766 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:01.218222 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:01.250410 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:01.251720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:01.254858 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:01.256530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:01.259322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:01.269390 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:01.556747 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:01.569866 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-71793d8e-7dd5-4cfc-b44a-7a7a08cab0c1 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1315 microversion: 2.1 time: 0.363964 Sep 06 20:25:01.570669 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 576/1194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:01 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:02.534219 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-ff089887-0ff5-418f-8721-21c68a4fc07a req-890c957c-bfdf-487e-a079-1e131fb75886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37af0c6a-5cc7-4aee-aad1-f720219ad38d", "tag": "51fb0825-c781-43dc-8d3f-25e6d809779a"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:25:02.568452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-ff089887-0ff5-418f-8721-21c68a4fc07a req-890c957c-bfdf-487e-a079-1e131fb75886 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:02.569776 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-ff089887-0ff5-418f-8721-21c68a4fc07a req-890c957c-bfdf-487e-a079-1e131fb75886 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:02.570835 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-ff089887-0ff5-418f-8721-21c68a4fc07a req-890c957c-bfdf-487e-a079-1e131fb75886 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:02.599177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-ff089887-0ff5-418f-8721-21c68a4fc07a req-890c957c-bfdf-487e-a079-1e131fb75886 service nova] Creating event network-changed:51fb0825-c781-43dc-8d3f-25e6d809779a for instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d on hv-cinder-84773 Sep 06 20:25:02.603207 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:02.604388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:02.609505 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-ff089887-0ff5-418f-8721-21c68a4fc07a req-890c957c-bfdf-487e-a079-1e131fb75886 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095667 Sep 06 20:25:02.611092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 619/1195] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:25:02.620760 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:02.621641 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:02.622641 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:02.624087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:02.624942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:02.625859 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:02.931126 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:02.948174 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6841a96d-2f48-453f-a403-6e7290f6251f tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1315 microversion: 2.1 time: 0.355269 Sep 06 20:25:02.948542 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 577/1196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:02 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:03.985963 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:03.986978 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:03.994027 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:03.994527 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:03.994966 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:03.995770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:03.996354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:03.996791 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:04.199252 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:04.209706 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8ae98139-5105-434b-8821-b6b7ec74254a tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1315 microversion: 2.1 time: 0.228510 Sep 06 20:25:04.210361 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 620/1197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:03 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:05.237230 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:05.238332 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:05.245523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:05.246087 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:05.246521 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:05.247241 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:05.247692 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:05.248116 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:05.425510 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:05.435328 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ecc0c1a3-51ee-4724-886f-ce68807ed7ba tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1315 microversion: 2.1 time: 0.203678 Sep 06 20:25:05.436027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 578/1198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:05 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:06.474072 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:06.475197 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:06.482721 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:06.483343 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:06.483896 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:06.484719 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:06.485258 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:06.485959 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:06.682452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:06.697525 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-2c19295e-fe80-4b6b-b84e-f6fe386ee282 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1315 microversion: 2.1 time: 0.228197 Sep 06 20:25:06.699056 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 621/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:06 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:25:07.662090 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-2ec5faf1-8811-432d-a485-cd13aa42bc37 req-7b158e11-3bd0-491e-992e-e3bbfa8f40e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37af0c6a-5cc7-4aee-aad1-f720219ad38d", "name": "network-vif-plugged", "status": "completed", "tag": "51fb0825-c781-43dc-8d3f-25e6d809779a"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:25:07.675127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:07.677146 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=6 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:07.693286 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2ec5faf1-8811-432d-a485-cd13aa42bc37 req-7b158e11-3bd0-491e-992e-e3bbfa8f40e4 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:07.694252 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2ec5faf1-8811-432d-a485-cd13aa42bc37 req-7b158e11-3bd0-491e-992e-e3bbfa8f40e4 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:07.695322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2ec5faf1-8811-432d-a485-cd13aa42bc37 req-7b158e11-3bd0-491e-992e-e3bbfa8f40e4 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:07.711450 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-2ec5faf1-8811-432d-a485-cd13aa42bc37 req-7b158e11-3bd0-491e-992e-e3bbfa8f40e4 service nova] Creating event network-vif-plugged:51fb0825-c781-43dc-8d3f-25e6d809779a for instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d on hv-cinder-84773 Sep 06 20:25:07.718310 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-2ec5faf1-8811-432d-a485-cd13aa42bc37 req-7b158e11-3bd0-491e-992e-e3bbfa8f40e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064759 Sep 06 20:25:07.719389 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 579/1200] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:25:07.741470 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:07.742196 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:07.750129 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:07.750770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:07.751350 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:07.752996 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:07.753462 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:07.753924 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:07.780860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:07.988929 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:08.000101 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-f1e17251-4bf6-4c86-a4d0-174fb6d4fc13 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1315 microversion: 2.1 time: 0.263569 Sep 06 20:25:08.001271 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 622/1201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:07 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:09.028086 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:09.029273 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:09.039573 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:09.040616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:09.041350 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:09.043041 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:09.043244 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:09.044019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:09.267177 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:09.277984 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-4a2ba4a7-782c-44c3-8ed4-2c7bce7c1ca6 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1315 microversion: 2.1 time: 0.255306 Sep 06 20:25:09.278769 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 580/1202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:09 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:10.305211 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:10.306378 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:10.317448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:10.318233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:10.318987 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:10.320354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:10.321272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:10.322354 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:10.791497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:10.802858 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-c9c2edd5-ba70-47e1-9588-8436d058f881 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1465 microversion: 2.1 time: 0.503705 Sep 06 20:25:10.804011 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 623/1203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:10 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1465 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:10.861018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:10.861830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:10.869453 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:10.870133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:10.870771 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:10.871731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:10.872393 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:10.872974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:10.907034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:25:11.018634 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-c930af3e-8484-4f31-b792-1a74c4405b96 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "DELETE /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 204 len: 0 microversion: 2.1 time: 0.161106 Sep 06 20:25:11.019986 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 581/1204] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:25:10 2022] DELETE /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:25:11.031770 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:11.032706 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:11.042432 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:11.043147 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:11.043755 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:11.044936 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:11.045687 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:11.046231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:11.265092 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:11.280619 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-1b2e7376-e8dc-42eb-ac58-a476d3ab20b2 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1471 microversion: 2.1 time: 0.254063 Sep 06 20:25:11.281707 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 624/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:11 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:12.322530 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:12.323520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:12.331750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:12.331750 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:12.332466 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:12.332949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:12.333479 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:12.333942 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:12.551655 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:12.574240 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-473d2fb8-56cd-4a99-993b-904067f50162 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1471 microversion: 2.1 time: 0.255739 Sep 06 20:25:12.578162 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 582/1206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:12 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:13.399483 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-31909c3c-1a13-4e7b-87e0-670ac9b1a95f req-976bd125-f7c8-4072-8164-c1f68f2a3bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37af0c6a-5cc7-4aee-aad1-f720219ad38d", "name": "network-vif-deleted", "tag": "51fb0825-c781-43dc-8d3f-25e6d809779a"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:25:13.438748 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-31909c3c-1a13-4e7b-87e0-670ac9b1a95f req-976bd125-f7c8-4072-8164-c1f68f2a3bea service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:13.439632 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-31909c3c-1a13-4e7b-87e0-670ac9b1a95f req-976bd125-f7c8-4072-8164-c1f68f2a3bea service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:13.440416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-31909c3c-1a13-4e7b-87e0-670ac9b1a95f req-976bd125-f7c8-4072-8164-c1f68f2a3bea service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:13.476451 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-31909c3c-1a13-4e7b-87e0-670ac9b1a95f req-976bd125-f7c8-4072-8164-c1f68f2a3bea service nova] Creating event network-vif-deleted:51fb0825-c781-43dc-8d3f-25e6d809779a for instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d on hv-cinder-84773 Sep 06 20:25:13.491551 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-31909c3c-1a13-4e7b-87e0-670ac9b1a95f req-976bd125-f7c8-4072-8164-c1f68f2a3bea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101862 Sep 06 20:25:13.493058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 625/1207] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:25:13.615107 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:13.616355 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:13.628476 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:13.629570 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:13.630907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:13.632522 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:13.633784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:13.634810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:13.700729 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:13.702290 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:13.703067 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:13.704205 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.objects.instance [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lazy-loading 'fault' on Instance uuid 37af0c6a-5cc7-4aee-aad1-f720219ad38d {{(pid=120951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:25:13.760616 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a7236719669467383c242d0f5a91604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7709cf0cbdb5418d92f698a66780e61f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:13.769219 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-a8dea079-9569-4fd0-9946-5b7488d85010 tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 200 len: 1305 microversion: 2.1 time: 0.162735 Sep 06 20:25:13.769895 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 583/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:13 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 1305 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:25:14.797928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:14.798815 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] [instance: 37af0c6a-5cc7-4aee-aad1-f720219ad38d] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:14.805881 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:14.806504 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:14.807006 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:14.807750 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:14.808223 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:14.808659 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:14.830606 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] HTTP exception thrown: Instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d could not be found. Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Request method failure captured: Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d HTTP/1.1 Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6yWWizuoeQhk7vxLnE8Er-j7HshqbaR8KYfgZlDgWsgYdrEWTlL8Do5puQdzNlWHxXHfMiSJwcvsv9cGwTfJ_a54SQNV-VW2Jk-KoziRUjHffP-9zd0EcFpeNdqIHF94bLUWXJmP5SZAlPxCuaqrLqq_fiopEtHQvlRsC6nXLK3ajs Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: 7709cf0cbdb5418d92f698a66780e61f Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-VolumesNegativeTest-1001021612 Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:25:14.833642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7709cf0cbdb5418d92f698a66780e61f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7709cf0cbdb5418d92f698a66780e61f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7709cf0cbdb5418d92f698a66780e61f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7709cf0cbdb5418d92f698a66780e61f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-VolumesNegativeTest-1001021612 Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: 7709cf0cbdb5418d92f698a66780e61f Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-VolumesNegativeTest-1001021612 Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-VolumesNegativeTest-1001021612-project Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 1a7236719669467383c242d0f5a91604 Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-VolumesNegativeTest-1001021612-project Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d could not be found. Sep 06 20:25:14.835682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': '37af0c6a-5cc7-4aee-aad1-f720219ad38d'} Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d could not be found. Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:25:14.836856 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d could not be found. Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d could not be found. Sep 06 20:25:14.838901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:25:14.841089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] Returning 404 to user: Instance 37af0c6a-5cc7-4aee-aad1-f720219ad38d could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:25:14.841089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-405b475e-c313-4bb2-9feb-897e311b851b tempest-VolumesNegativeTest-1001021612 tempest-VolumesNegativeTest-1001021612-project] 10.222.0.20 "GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d" status: 404 len: 111 microversion: 2.1 time: 0.043610 Sep 06 20:25:14.841789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 626/1209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:14 2022] GET /compute/v2.1/servers/37af0c6a-5cc7-4aee-aad1-f720219ad38d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:25:58.948893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:58.950600 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:58.954710 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:58.955755 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:58.966819 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:58.967769 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:58.968365 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:58.970032 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:58.970683 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:58.971268 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:59.023231 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Going to try to terminate instance {{(pid=120951) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:25:59.143275 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-dfd6f41e-2378-480a-afbe-53fdf5b6fc05 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 204 len: 0 microversion: 2.1 time: 0.198508 Sep 06 20:25:59.144712 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 584/1210] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:25:58 2022] DELETE /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:25:59.157803 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:25:59.159071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:25:59.164133 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 06 20:25:59.165452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=22 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:59.166807 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=42 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:59.183991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:59.184875 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:59.185725 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:59.187769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:25:59.187769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:25:59.189453 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:25:59.415708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:25:59.424625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-03d97199-e382-46ea-88e5-54f2314eac3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1577 microversion: 2.1 time: 0.275216 Sep 06 20:25:59.425267 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 627/1211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:25:59 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1577 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:00.451764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:00.452685 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:00.460646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:00.461133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:00.461567 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:00.462320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:00.462785 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:00.463205 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:00.768519 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:00.777170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-993432f6-69ad-42ce-8644-c812ba64f576 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1577 microversion: 2.1 time: 0.329893 Sep 06 20:26:00.778080 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 585/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:00 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1577 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:01.803998 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:01.804650 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:01.811480 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:01.811968 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:01.812492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:01.813315 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:01.813808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:01.814233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:01.896044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:01.912801 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-62c8b850-102c-475a-bd28-c79e2bc60913 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1509 microversion: 2.1 time: 0.112886 Sep 06 20:26:01.914134 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 628/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:01 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1509 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:02.311179 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-bf66fdea-e3e3-4de2-8ed2-5eaaa201f98f req-ed6f1750-8923-4755-8354-0820eab1a153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3fd9b1e-42f7-4866-9581-cd510ab72f07", "name": "network-vif-deleted", "tag": "bae9f4be-00e2-46b1-b212-d046ee0329f6"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:26:02.324974 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-bf66fdea-e3e3-4de2-8ed2-5eaaa201f98f req-ed6f1750-8923-4755-8354-0820eab1a153 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:02.325502 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-bf66fdea-e3e3-4de2-8ed2-5eaaa201f98f req-ed6f1750-8923-4755-8354-0820eab1a153 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:02.326078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-bf66fdea-e3e3-4de2-8ed2-5eaaa201f98f req-ed6f1750-8923-4755-8354-0820eab1a153 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:02.343317 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-bf66fdea-e3e3-4de2-8ed2-5eaaa201f98f req-ed6f1750-8923-4755-8354-0820eab1a153 service nova] Creating event network-vif-deleted:bae9f4be-00e2-46b1-b212-d046ee0329f6 for instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 on hv-cinder-84773 Sep 06 20:26:02.350821 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-bf66fdea-e3e3-4de2-8ed2-5eaaa201f98f req-ed6f1750-8923-4755-8354-0820eab1a153 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178062 Sep 06 20:26:02.351744 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 586/1214] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:26:02.938949 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:02.939911 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:02.948089 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:02.948848 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:02.949471 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:02.950506 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:02.951097 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:02.951640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:02.991646 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:02.992145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:02.992591 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:02.993148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lazy-loading 'fault' on Instance uuid d3fd9b1e-42f7-4866-9581-cd510ab72f07 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:26:03.042391 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:03.052583 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-615470e4-53eb-48ca-91e0-b4a21b89c511 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 200 len: 1230 microversion: 2.1 time: 0.118139 Sep 06 20:26:03.053107 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 629/1215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:02 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:26:04.077807 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:04.079532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:04.085928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:04.086424 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:04.086865 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:04.087591 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:04.088049 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:04.088479 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:04.105443 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] HTTP exception thrown: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Request method failure captured: Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 HTTP/1.1 Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6wdOq2sUsiT5usZ2Rji6yHTKGgvpyGisl7-F-v1tYYF8GLFMe6h6ZUDA8CuDIR5TkYFqkcjuiKM38JXFwiFuX8puKmDFSQu2okc6PUKtFFrH3TwkWok14q6qnt3eVtkkCpDkKM_R45QXErPEeZ2Gmxi5meuvrleOIKhHzQRMJTrYNo Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:26:04.107184 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-TestVolumeBootPattern-57222979 Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 7f661aa1f00e4c7e916b2498505475dc Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:26:04.110523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'd3fd9b1e-42f7-4866-9581-cd510ab72f07'} Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:26:04.112369 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:26:04.115461 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:26:04.118212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Returning 404 to user: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:26:04.118212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-1f105b57-e441-484a-af4d-c6e7b2d36319 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 404 len: 111 microversion: 2.1 time: 0.035761 Sep 06 20:26:04.118212 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 587/1216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:04 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:26:04.246733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1075209229", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-556363554", "security_groups": [{"name": "tempest-secgroup-smoke-1329946770"}], "block_device_mapping_v2": [{"uuid": "00c8eb4e-f82e-40d7-98b0-d4aa1ced9b64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "91efb276-dca9-4ee1-91ca-f3bfd747bb6a"}]}} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:26:04.398357 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.network.neutron [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] validate_networks() for [('91efb276-dca9-4ee1-91ca-f3bfd747bb6a', None, None, None, None, None)] {{(pid=120952) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:26:04.951766 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Flavor limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:26:04.952393 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Image limits 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:26:04.952986 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Flavor pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:26:04.954783 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Image pref 0:0:0 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:26:04.954783 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.virt.hardware [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120952) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:26:04.964620 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:04.965114 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:04.965592 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:04.966662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:04.966872 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:04.967288 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:04.988612 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for project ed4697b9e0a940b284b392b3e93197c7. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:26:04.993494 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.quota [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for user 7f661aa1f00e4c7e916b2498505475dc and project ed4697b9e0a940b284b392b3e93197c7. Resources: {'instances', 'ram', 'cores'} {{(pid=120952) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:26:05.077386 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Going to run 1 instances... {{(pid=120952) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:26:05.082205 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00c8eb4e-f82e-40d7-98b0-d4aa1ced9b64',volume_size=None,volume_type=None)] {{(pid=120952) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:26:05.245824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-a880e6e9-8f55-4d21-ba9d-e146675bafc4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.002970 Sep 06 20:26:05.246734 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 630/1217] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:26:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 20:26:05.259997 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-de70fa84-7eb8-4238-ab70-bd4cf50e379f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:05.260657 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-de70fa84-7eb8-4238-ab70-bd4cf50e379f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:05.330481 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-de70fa84-7eb8-4238-ab70-bd4cf50e379f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:05.341059 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-de70fa84-7eb8-4238-ab70-bd4cf50e379f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1094 microversion: 2.1 time: 0.084935 Sep 06 20:26:05.341908 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 588/1218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:05 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:06.380860 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:06.381966 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:06.389399 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:06.389928 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:06.390512 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:06.392096 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:06.392970 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:06.393662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:06.474294 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:06.485520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-0da1b077-6eb6-429d-a80b-fc3fa2423f5e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1192 microversion: 2.1 time: 0.110607 Sep 06 20:26:06.486373 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 631/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:06 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:26:07.516943 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:07.518285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:07.532532 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:07.533523 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:07.534439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:07.535775 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:07.536725 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:07.537596 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:07.690422 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:07.709437 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-561f6290-957e-4d16-88b3-2a3d4a2244f3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1210 microversion: 2.1 time: 0.200690 Sep 06 20:26:07.710008 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 589/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:07 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1210 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:08.739029 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:08.740071 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:08.748844 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:08.749498 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:08.750126 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:08.751119 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:08.751849 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:08.752362 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:08.799911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-0da7cf75-28cd-40f9-9cb7-c5c2eb0cb5c5 req-f2ad30e1-6442-40d9-945b-482095e14ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25980179-c2e1-4578-858d-5365ade3a2d4", "tag": "cbb5c9a7-7a07-432e-89aa-f4407605275f"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:26:08.821408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 20:26:08.821760 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Tue Sep 6 20:26:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 20:26:08.840906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-0da7cf75-28cd-40f9-9cb7-c5c2eb0cb5c5 req-f2ad30e1-6442-40d9-945b-482095e14ab0 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:08.842731 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-0da7cf75-28cd-40f9-9cb7-c5c2eb0cb5c5 req-f2ad30e1-6442-40d9-945b-482095e14ab0 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:08.843971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-0da7cf75-28cd-40f9-9cb7-c5c2eb0cb5c5 req-f2ad30e1-6442-40d9-945b-482095e14ab0 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:08.872813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-0da7cf75-28cd-40f9-9cb7-c5c2eb0cb5c5 req-f2ad30e1-6442-40d9-945b-482095e14ab0 service nova] Creating event network-changed:cbb5c9a7-7a07-432e-89aa-f4407605275f for instance 25980179-c2e1-4578-858d-5365ade3a2d4 on hv-cinder-84773 Sep 06 20:26:08.883131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-0da7cf75-28cd-40f9-9cb7-c5c2eb0cb5c5 req-f2ad30e1-6442-40d9-945b-482095e14ab0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093099 Sep 06 20:26:08.884320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 590/1221] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:26:08.985093 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:08.994675 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d80cebe6-c90a-46a1-a7a4-9c3fe6e50f82 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.261119 Sep 06 20:26:08.995884 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 632/1222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:08 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:10.028027 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:10.029327 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:10.040937 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:10.042148 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:10.042935 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:10.044205 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:10.045034 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:10.045830 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:10.299511 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:10.311897 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-36dd8e19-5ef5-4fef-b1eb-140ace6dae54 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.292930 Sep 06 20:26:10.312688 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 591/1223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:10 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:11.339590 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:11.340395 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:11.350482 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:11.351344 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:11.352180 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:11.353406 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:11.354270 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:11.355095 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:11.540154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:11.549140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3952b7d2-9091-485c-bc31-a4ff838a3964 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.214164 Sep 06 20:26:11.549763 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 633/1224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:11 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:12.573127 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:12.573936 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:12.582320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:12.582852 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:12.583430 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:12.584256 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:12.584809 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:12.585330 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:12.766807 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:12.775708 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-79edf6f5-f07d-4ae4-a920-988fb4aba2bf tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.206925 Sep 06 20:26:12.776300 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 592/1225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:12 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:13.803145 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:13.804472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:13.812682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:13.813179 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:13.813640 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:13.814415 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:13.814810 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:13.815231 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:13.995662 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:14.004452 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-7516c683-92cb-4966-9da7-078c80cbf3d3 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.208272 Sep 06 20:26:14.005272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 634/1226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:13 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:15.028644 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:15.029338 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:15.037420 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:15.037938 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:15.038370 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:15.039076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:15.039526 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:15.040060 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:15.203958 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:15.212853 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7fc56900-09f6-4790-ae14-d24aa0fc5c91 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.188576 Sep 06 20:26:15.213573 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 593/1227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:15 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:26:16.239870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:16.240580 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:16.243317 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:16.244324 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=6 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:16.251823 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:16.252400 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:16.252879 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:16.253834 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:16.254347 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:16.254820 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:16.415459 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:16.424540 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-516d8a57-6bcb-4607-961f-4fd8e690fd95 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.188892 Sep 06 20:26:16.425140 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 635/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:16 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 20:26:17.453052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:17.454426 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:17.456710 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:17.463776 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:17.464266 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:17.464808 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:17.465681 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:17.466143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:17.466571 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:17.636706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:17.652251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-fdf5bbd1-585d-48cc-8b37-86262ed0a38d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.204997 Sep 06 20:26:17.653598 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 594/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:17 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:18.690708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:18.691611 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:18.699566 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:18.700087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:18.700520 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:18.701233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:18.701811 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:18.702235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:18.862847 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:18.872988 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b146d130-de35-4cca-b767-85d5c32892a6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.186351 Sep 06 20:26:18.873780 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 636/1230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:18 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:19.899384 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:19.900152 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:19.911156 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:19.912021 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:19.912800 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:19.914226 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:19.915035 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:19.915689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:20.169789 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:20.184691 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6fa8bd1e-c257-488d-8fb1-be44ddda39e9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.289602 Sep 06 20:26:20.185949 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 595/1231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:19 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:20.194264 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-03b8f81d-5128-4b9d-a158-2d92830f9dd0 req-420e9890-6272-4081-a14b-dc3725cf3a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25980179-c2e1-4578-858d-5365ade3a2d4", "name": "network-vif-plugged", "status": "completed", "tag": "cbb5c9a7-7a07-432e-89aa-f4407605275f"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:26:20.213728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-03b8f81d-5128-4b9d-a158-2d92830f9dd0 req-420e9890-6272-4081-a14b-dc3725cf3a23 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:20.214815 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-03b8f81d-5128-4b9d-a158-2d92830f9dd0 req-420e9890-6272-4081-a14b-dc3725cf3a23 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:20.215381 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-03b8f81d-5128-4b9d-a158-2d92830f9dd0 req-420e9890-6272-4081-a14b-dc3725cf3a23 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:20.229150 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-03b8f81d-5128-4b9d-a158-2d92830f9dd0 req-420e9890-6272-4081-a14b-dc3725cf3a23 service nova] Creating event network-vif-plugged:cbb5c9a7-7a07-432e-89aa-f4407605275f for instance 25980179-c2e1-4578-858d-5365ade3a2d4 on hv-cinder-84773 Sep 06 20:26:20.235600 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-03b8f81d-5128-4b9d-a158-2d92830f9dd0 req-420e9890-6272-4081-a14b-dc3725cf3a23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157517 Sep 06 20:26:20.236233 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 637/1232] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:26:21.224019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:21.224687 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:21.232069 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:21.232563 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:21.233058 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:21.233769 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:21.234223 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:21.234644 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:21.400906 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:21.410561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-bec2f2e5-b1a2-402a-843e-716ec0d4af2e tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1266 microversion: 2.1 time: 0.191189 Sep 06 20:26:21.411320 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 596/1233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:21 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:22.436789 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:22.438324 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:22.455177 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:22.456163 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:22.457076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:22.458235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:22.459031 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:22.459797 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:22.667422 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:22.676769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-142fbd63-443c-420a-aa57-b6ec5bbb8b6b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1452 microversion: 2.1 time: 0.245234 Sep 06 20:26:22.677481 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 638/1234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:22 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1452 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:22.715339 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:26:22.716178 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:26:22.723677 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:22.724165 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:22.724647 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:22.725319 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:22.725810 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:22.726236 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:22.888164 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:26:22.904124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-40caaa8c-da1b-4911-b650-26b076cc8d3f tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1452 microversion: 2.1 time: 0.192574 Sep 06 20:26:22.905264 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 597/1235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:26:22 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:26:25.956492 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [req-762b8321-0d09-481e-90f7-3697dc311009 req-0d7dd564-6371-4f7d-a320-5c434c830032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25980179-c2e1-4578-858d-5365ade3a2d4", "tag": "cbb5c9a7-7a07-432e-89aa-f4407605275f"}]} {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:26:25.967135 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-762b8321-0d09-481e-90f7-3697dc311009 req-0d7dd564-6371-4f7d-a320-5c434c830032 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:26:25.967623 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-762b8321-0d09-481e-90f7-3697dc311009 req-0d7dd564-6371-4f7d-a320-5c434c830032 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:26:25.968059 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [req-762b8321-0d09-481e-90f7-3697dc311009 req-0d7dd564-6371-4f7d-a320-5c434c830032 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:26:25.981052 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.compute.server_external_events [req-762b8321-0d09-481e-90f7-3697dc311009 req-0d7dd564-6371-4f7d-a320-5c434c830032 service nova] Creating event network-changed:cbb5c9a7-7a07-432e-89aa-f4407605275f for instance 25980179-c2e1-4578-858d-5365ade3a2d4 on hv-cinder-84773 Sep 06 20:26:25.989019 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [req-762b8321-0d09-481e-90f7-3697dc311009 req-0d7dd564-6371-4f7d-a320-5c434c830032 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110181 Sep 06 20:26:25.989935 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 639/1236] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:28:05.201181 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:05.202535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:05.203842 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 20:28:05.204076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Tue Sep 6 20:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Sep 06 20:28:05.211110 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1875815229", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-556363554", "security_groups": [{"name": "tempest-secgroup-smoke-1329946770"}], "block_device_mapping_v2": [{"uuid": "d623d071-0b40-4f29-bca6-d8c4c3308891", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "91efb276-dca9-4ee1-91ca-f3bfd747bb6a"}]}} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:28:05.361386 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.network.neutron [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] validate_networks() for [('91efb276-dca9-4ee1-91ca-f3bfd747bb6a', None, None, None, None, None)] {{(pid=120951) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 20:28:05.912093 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Flavor limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 20:28:05.912515 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Image limits 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 20:28:05.913001 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Flavor pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 20:28:05.913455 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Image pref 0:0:0 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 20:28:05.913911 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.virt.hardware [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 20:28:05.927195 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:05.927689 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:05.928132 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:05.928883 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:05.929366 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:05.929968 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:05.949877 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for project ed4697b9e0a940b284b392b3e93197c7. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 20:28:05.954914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.quota [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Getting quotas for user 7f661aa1f00e4c7e916b2498505475dc and project ed4697b9e0a940b284b392b3e93197c7. Resources: {'instances', 'ram', 'cores'} {{(pid=120951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 20:28:06.044006 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Going to run 1 instances... {{(pid=120951) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 20:28:06.046344 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d623d071-0b40-4f29-bca6-d8c4c3308891',volume_size=None,volume_type=None)] {{(pid=120951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 20:28:06.231442 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2343a98c-34b1-433e-ab44-f38f5535203a tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.032193 Sep 06 20:28:06.232656 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 598/1237] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 6 20:28:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 20:28:06.249754 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR oslo.messaging._drivers.impl_rabbit [-] [003ee9c8-d538-4394-b45f-6db902007362] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 20:28:06.250642 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:06.251955 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=68 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:06.253365 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 20:28:06.253593 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Tue Sep 6 20:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 (ip 10.222.0.20) !!! Sep 06 20:28:06.263711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-e49bca24-51b5-4083-a690-350293cfeabd tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:06.265182 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-e49bca24-51b5-4083-a690-350293cfeabd tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:06.343190 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-e49bca24-51b5-4083-a690-350293cfeabd tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:06.354256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-e49bca24-51b5-4083-a690-350293cfeabd tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1094 microversion: 2.1 time: 0.108933 Sep 06 20:28:06.355179 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 640/1238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:06 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:07.381139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:07.381890 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:07.388784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:07.389940 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:07.390383 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:07.391106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:07.391574 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:07.392182 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:07.477764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:07.487813 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-ab287025-497d-4338-860a-4deef0f7b944 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1192 microversion: 2.1 time: 0.111163 Sep 06 20:28:07.488423 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 599/1239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:07 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:08.516109 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:08.519014 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:08.530955 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:08.533536 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:08.534228 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:08.535568 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:08.536712 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:08.537730 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:08.578853 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO oslo.messaging._drivers.impl_rabbit [-] [003ee9c8-d538-4394-b45f-6db902007362] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50860. Sep 06 20:28:08.788521 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:08.798393 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-051ebde6-790e-4d7a-993b-94aa4b2bea98 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.288648 Sep 06 20:28:08.798962 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 641/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:08 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:09.463271 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-4207b246-3339-473e-9928-211ee9ddd7c7 req-8acf2e90-e95c-4f57-83fe-24503aefaca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd302a02-9467-4e36-89b2-4d61bec2bfc2", "tag": "2944a5f0-ac68-4789-a389-64881c904a74"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:28:09.477735 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4207b246-3339-473e-9928-211ee9ddd7c7 req-8acf2e90-e95c-4f57-83fe-24503aefaca7 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:09.478415 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4207b246-3339-473e-9928-211ee9ddd7c7 req-8acf2e90-e95c-4f57-83fe-24503aefaca7 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:09.479022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-4207b246-3339-473e-9928-211ee9ddd7c7 req-8acf2e90-e95c-4f57-83fe-24503aefaca7 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:09.492969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-4207b246-3339-473e-9928-211ee9ddd7c7 req-8acf2e90-e95c-4f57-83fe-24503aefaca7 service nova] Creating event network-changed:2944a5f0-ac68-4789-a389-64881c904a74 for instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 on hv-cinder-84773 Sep 06 20:28:09.505561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-4207b246-3339-473e-9928-211ee9ddd7c7 req-8acf2e90-e95c-4f57-83fe-24503aefaca7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046191 Sep 06 20:28:09.506559 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 600/1241] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:28:09.829794 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:09.830894 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:09.843275 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:09.844106 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:09.844881 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:09.846167 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:09.846971 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:09.847696 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:10.039320 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:10.049044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5eb13a95-f1b0-4a98-992e-15c7ed0b8767 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.226641 Sep 06 20:28:10.049044 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 642/1242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:09 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:11.074045 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:11.075062 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:11.082767 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:11.083265 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:11.083715 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:11.084447 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:11.085073 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:11.085520 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:11.256704 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:11.265825 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-6218c5a7-13c6-4ca6-8c14-daa4b7f52fc2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.196728 Sep 06 20:28:11.266527 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 601/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:11 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:12.290682 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:12.291788 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:12.300087 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:12.300979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:12.301316 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:12.301785 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:12.302251 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:12.302674 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:12.461045 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:12.470172 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-3b6f1253-fffc-4cf2-8e50-0951bfc4f685 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.183560 Sep 06 20:28:12.470769 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 643/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:12 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:13.494309 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:13.494970 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:13.503125 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:13.503670 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:13.504154 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:13.504991 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:13.505487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:13.506022 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:13.681040 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:13.690281 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-31e4618e-a6f7-4da7-a1eb-8dddd37fd6b8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.199926 Sep 06 20:28:13.690879 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 602/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:13 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:14.716116 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:14.716994 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:14.727979 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:14.728877 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:14.729702 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:14.731708 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:14.733076 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:14.733864 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:14.925749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:14.940857 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-efbf5548-3878-4c48-afa2-a84a6ce4aa88 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.228996 Sep 06 20:28:14.942111 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 644/1246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:14 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:15.969702 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:15.970578 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:15.973076 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=2 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:15.973868 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell0:SELECT=6 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:15.980078 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:15.980579 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:15.981018 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:15.981784 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:15.982243 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:15.983304 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:16.153938 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:16.167719 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-7a07e8c9-55dc-4f6f-84a3-1507ffb13a1d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.202892 Sep 06 20:28:16.168762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 603/1247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:15 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:17.210733 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:17.211398 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:17.214094 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell0:SELECT=2 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:17.220479 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:17.220965 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:17.221409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:17.222148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:17.222661 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:17.223081 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:17.383573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:17.393041 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-adac39f2-48de-4f91-9b34-d571b0ccd9b9 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.186571 Sep 06 20:28:17.393690 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 645/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:17 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:18.434535 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:18.435188 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:18.442054 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:18.442543 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:18.442976 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:18.443674 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:18.444131 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:18.444551 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:18.620548 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:18.638449 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-23453865-a985-4796-83a9-62dcf2b78112 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.209068 Sep 06 20:28:18.641385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 604/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:18 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:19.670989 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:19.671710 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:19.679547 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:19.680105 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:19.680582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:19.681497 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:19.682426 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:19.682991 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:19.843964 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:19.852883 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-8f6570af-fc82-42ae-8cfb-2d223190aa08 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.185878 Sep 06 20:28:19.853493 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 646/1250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:19 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:20.542764 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-2c157dfe-69b2-43c6-a34f-813defe95b8c req-8f8f2b26-c7d9-4479-a67d-7b720a6f299c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd302a02-9467-4e36-89b2-4d61bec2bfc2", "name": "network-vif-plugged", "status": "completed", "tag": "2944a5f0-ac68-4789-a389-64881c904a74"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:28:20.566408 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2c157dfe-69b2-43c6-a34f-813defe95b8c req-8f8f2b26-c7d9-4479-a67d-7b720a6f299c service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:20.567274 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2c157dfe-69b2-43c6-a34f-813defe95b8c req-8f8f2b26-c7d9-4479-a67d-7b720a6f299c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:20.568379 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-2c157dfe-69b2-43c6-a34f-813defe95b8c req-8f8f2b26-c7d9-4479-a67d-7b720a6f299c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:20.590917 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-2c157dfe-69b2-43c6-a34f-813defe95b8c req-8f8f2b26-c7d9-4479-a67d-7b720a6f299c service nova] Creating event network-vif-plugged:2944a5f0-ac68-4789-a389-64881c904a74 for instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 on hv-cinder-84773 Sep 06 20:28:20.599707 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-2c157dfe-69b2-43c6-a34f-813defe95b8c req-8f8f2b26-c7d9-4479-a67d-7b720a6f299c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064070 Sep 06 20:28:20.600841 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 605/1251] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:28:20.879379 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:20.880335 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:20.891058 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:20.891946 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:20.892728 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:20.894130 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:20.894931 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:20.895684 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:21.113148 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:21.121440 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-15c0a1fe-590d-45c6-9728-aed9f4f230f0 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1266 microversion: 2.1 time: 0.248476 Sep 06 20:28:21.122256 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 647/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:20 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:22.152376 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:22.153665 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:22.165388 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:22.166251 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:22.166969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:22.168183 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:22.168983 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:22.169745 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:22.401385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:22.419699 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-2eeb59e5-73a0-4044-887e-ebf8bc856334 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1452 microversion: 2.1 time: 0.275522 Sep 06 20:28:22.420439 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 606/1253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:22 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1452 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:22.465389 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:28:22.466544 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:28:22.479680 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:22.480625 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:22.481491 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:22.482990 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:22.483841 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:22.484621 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:22.681328 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:28:22.691193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-d7d9c57a-c678-4ee6-8065-639a92ae5b38 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1452 microversion: 2.1 time: 0.234101 Sep 06 20:28:22.691795 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 648/1254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:28:22 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1452 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:28:25.222788 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-8ccf394b-b002-4efb-81cc-dcb11451ba0b req-06b6da64-e72e-4dae-a0b5-05a209640ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd302a02-9467-4e36-89b2-4d61bec2bfc2", "tag": "2944a5f0-ac68-4789-a389-64881c904a74"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:28:25.233385 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-8ccf394b-b002-4efb-81cc-dcb11451ba0b req-06b6da64-e72e-4dae-a0b5-05a209640ba2 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:28:25.233907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-8ccf394b-b002-4efb-81cc-dcb11451ba0b req-06b6da64-e72e-4dae-a0b5-05a209640ba2 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:28:25.234337 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-8ccf394b-b002-4efb-81cc-dcb11451ba0b req-06b6da64-e72e-4dae-a0b5-05a209640ba2 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:28:25.247556 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-8ccf394b-b002-4efb-81cc-dcb11451ba0b req-06b6da64-e72e-4dae-a0b5-05a209640ba2 service nova] Creating event network-changed:2944a5f0-ac68-4789-a389-64881c904a74 for instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 on hv-cinder-84773 Sep 06 20:28:25.253239 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-8ccf394b-b002-4efb-81cc-dcb11451ba0b req-06b6da64-e72e-4dae-a0b5-05a209640ba2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034496 Sep 06 20:28:25.253941 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 607/1255] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:30:05.206326 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_api:SELECT=20 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:05.208327 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG dbcounter [-] [120952] Writing DB stats nova_cell1:SELECT=48 {{(pid=120952) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:05.210404 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 20:30:05.210940 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Tue Sep 6 20:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 (ip 10.222.0.20) !!! Sep 06 20:30:05.214500 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:05.215720 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG dbcounter [-] [120951] Writing DB stats nova_cell1:SELECT=44 {{(pid=120951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:05.217211 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 20:30:05.217416 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Tue Sep 6 20:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 (ip 10.222.0.20) !!! Sep 06 20:30:05.219628 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 20:30:05.219928 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Tue Sep 6 20:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Sep 06 20:30:05.229143 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-853f2acc-827d-40b1-aa23-3a439dfd27a7 req-7ee9510f-0a9f-4d0c-bf95-b31475c45655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd302a02-9467-4e36-89b2-4d61bec2bfc2", "tag": "2944a5f0-ac68-4789-a389-64881c904a74"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:30:05.251403 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:05.252727 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:05.254878 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-853f2acc-827d-40b1-aa23-3a439dfd27a7 req-7ee9510f-0a9f-4d0c-bf95-b31475c45655 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:05.256019 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-853f2acc-827d-40b1-aa23-3a439dfd27a7 req-7ee9510f-0a9f-4d0c-bf95-b31475c45655 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:05.257240 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-853f2acc-827d-40b1-aa23-3a439dfd27a7 req-7ee9510f-0a9f-4d0c-bf95-b31475c45655 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:05.267485 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:05.268191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:05.268914 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:05.270173 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:05.270952 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:05.271663 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:05.280580 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-853f2acc-827d-40b1-aa23-3a439dfd27a7 req-7ee9510f-0a9f-4d0c-bf95-b31475c45655 service nova] Creating event network-changed:2944a5f0-ac68-4789-a389-64881c904a74 for instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 on hv-cinder-84773 Sep 06 20:30:05.292003 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-853f2acc-827d-40b1-aa23-3a439dfd27a7 req-7ee9510f-0a9f-4d0c-bf95-b31475c45655 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081404 Sep 06 20:30:05.293036 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 608/1256] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:30:05.328430 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:30:05.486799 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-4d01cab4-24c9-449d-8063-c233159076b2 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 204 len: 0 microversion: 2.1 time: 0.281820 Sep 06 20:30:05.488673 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 649/1257] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:30:05 2022] DELETE /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:30:05.499013 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:05.499751 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:05.513169 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:05.514097 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:05.514963 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:05.516288 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:05.517139 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:05.518381 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:05.755489 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:30:05.770722 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-0c55c6a9-0305-45a7-93b4-119cc186883b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1577 microversion: 2.1 time: 0.276174 Sep 06 20:30:05.771896 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 609/1258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:05 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1577 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:30:06.812883 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:06.814035 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:06.821532 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:06.822191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:06.822745 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:06.823582 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:06.824154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:06.824677 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:06.999985 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:30:07.009032 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6699dd94-468a-449f-bc90-db9382daf649 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1577 microversion: 2.1 time: 0.201186 Sep 06 20:30:07.009580 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 650/1259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:06 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:30:07.844052 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-b547fbd9-53b4-4811-bdf5-73adc4c8febd req-5934d032-1183-4251-a723-46400be10159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd302a02-9467-4e36-89b2-4d61bec2bfc2", "name": "network-vif-deleted", "tag": "2944a5f0-ac68-4789-a389-64881c904a74"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:30:07.858105 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b547fbd9-53b4-4811-bdf5-73adc4c8febd req-5934d032-1183-4251-a723-46400be10159 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:07.858746 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b547fbd9-53b4-4811-bdf5-73adc4c8febd req-5934d032-1183-4251-a723-46400be10159 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:07.859328 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-b547fbd9-53b4-4811-bdf5-73adc4c8febd req-5934d032-1183-4251-a723-46400be10159 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:07.873253 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-b547fbd9-53b4-4811-bdf5-73adc4c8febd req-5934d032-1183-4251-a723-46400be10159 service nova] Creating event network-vif-deleted:2944a5f0-ac68-4789-a389-64881c904a74 for instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 on hv-cinder-84773 Sep 06 20:30:07.879380 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-b547fbd9-53b4-4811-bdf5-73adc4c8febd req-5934d032-1183-4251-a723-46400be10159 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039628 Sep 06 20:30:07.879975 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 610/1260] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:30:08.036363 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:08.037749 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:08.050814 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:08.051274 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:08.051796 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:08.052572 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:08.053046 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:08.053489 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:08.138085 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:30:08.153855 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-9124a68f-dd4e-4dbe-97e1-7ac076567cb6 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 200 len: 1225 microversion: 2.1 time: 0.121830 Sep 06 20:30:08.155193 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 651/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:08 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:30:09.197482 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:09.198577 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: bd302a02-9467-4e36-89b2-4d61bec2bfc2] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:09.206561 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:09.207106 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:09.207821 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:09.209201 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:09.209789 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:09.210303 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:09.227893 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] HTTP exception thrown: Instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 could not be found. Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Request method failure captured: Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 HTTP/1.1 Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6wdOq2sUsiT5usZ2Rji6yHTKGgvpyGisl7-F-v1tYYF8GLFMe6h6ZUDA8CuDIR5TkYFqkcjuiKM38JXFwiFuX8puKmDFSQu2okc6PUKtFFrH3TwkWok14q6qnt3eVtkkCpDkKM_R45QXErPEeZ2Gmxi5meuvrleOIKhHzQRMJTrYNo Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:30:09.229805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 7f661aa1f00e4c7e916b2498505475dc Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 could not be found. Sep 06 20:30:09.233096 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'bd302a02-9467-4e36-89b2-4d61bec2bfc2'} Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 could not be found. Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:30:09.234706 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 could not be found. Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 could not be found. Sep 06 20:30:09.237318 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:09.240004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Returning 404 to user: Instance bd302a02-9467-4e36-89b2-4d61bec2bfc2 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:30:09.240004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-dbaec217-f57a-4cfa-b562-a61f86bfb6f8 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2" status: 404 len: 111 microversion: 2.1 time: 0.041119 Sep 06 20:30:09.240004 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 611/1262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:09 2022] GET /compute/v2.1/servers/bd302a02-9467-4e36-89b2-4d61bec2bfc2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:30:12.870646 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-a6245f64-b4a1-4836-9853-f92a22425dc3 req-9bdcd9e3-3c9e-4738-8a2f-38b1f7bce58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25980179-c2e1-4578-858d-5365ade3a2d4", "tag": "cbb5c9a7-7a07-432e-89aa-f4407605275f"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:30:12.872791 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:12.873806 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:12.881850 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-a6245f64-b4a1-4836-9853-f92a22425dc3 req-9bdcd9e3-3c9e-4738-8a2f-38b1f7bce58c service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:12.882326 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-a6245f64-b4a1-4836-9853-f92a22425dc3 req-9bdcd9e3-3c9e-4738-8a2f-38b1f7bce58c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:12.883095 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-a6245f64-b4a1-4836-9853-f92a22425dc3 req-9bdcd9e3-3c9e-4738-8a2f-38b1f7bce58c service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:12.885461 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:12.886824 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:12.887701 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:12.889191 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:12.890166 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:12.891028 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:12.897487 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-a6245f64-b4a1-4836-9853-f92a22425dc3 req-9bdcd9e3-3c9e-4738-8a2f-38b1f7bce58c service nova] Creating event network-changed:cbb5c9a7-7a07-432e-89aa-f4407605275f for instance 25980179-c2e1-4578-858d-5365ade3a2d4 on hv-cinder-84773 Sep 06 20:30:12.904399 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-a6245f64-b4a1-4836-9853-f92a22425dc3 req-9bdcd9e3-3c9e-4738-8a2f-38b1f7bce58c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037294 Sep 06 20:30:12.905324 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 612/1263] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 20:30:12.945818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Going to try to terminate instance {{(pid=120952) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 20:30:13.116154 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-6004e41b-11ac-472e-8589-9273ee4e1899 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 204 len: 0 microversion: 2.1 time: 0.250085 Sep 06 20:30:13.117561 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 652/1264] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:30:12 2022] DELETE /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 20:30:13.131867 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:13.133258 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:13.146513 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:13.147907 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:13.148981 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:13.150666 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:13.151805 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:13.152583 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:13.410565 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.policy [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120951) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:30:13.420988 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-3dbec613-6551-4b8f-ad0c-017bebd6e75d tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1577 microversion: 2.1 time: 0.296470 Sep 06 20:30:13.421747 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 613/1265] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:13 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1577 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:30:14.459021 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:14.460259 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:14.475573 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:14.477013 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:14.478472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:14.480427 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:14.481555 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:14.482757 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:14.985857 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:30:15.006818 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-54956025-19c0-47e0-b15e-de196cee3aba tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1577 microversion: 2.1 time: 0.557486 Sep 06 20:30:15.008594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 653/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:14 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1577 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:30:15.531133 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [req-26d3be39-e93a-4829-9bf6-1bbadd6c46ea req-e5235d21-20e2-4bd1-85ad-433cb62a1a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25980179-c2e1-4578-858d-5365ade3a2d4", "name": "network-vif-deleted", "tag": "cbb5c9a7-7a07-432e-89aa-f4407605275f"}]} {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 20:30:15.552285 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-26d3be39-e93a-4829-9bf6-1bbadd6c46ea req-e5235d21-20e2-4bd1-85ad-433cb62a1a79 service nova] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:15.553124 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-26d3be39-e93a-4829-9bf6-1bbadd6c46ea req-e5235d21-20e2-4bd1-85ad-433cb62a1a79 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:15.553914 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [req-26d3be39-e93a-4829-9bf6-1bbadd6c46ea req-e5235d21-20e2-4bd1-85ad-433cb62a1a79 service nova] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:15.573457 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.compute.server_external_events [req-26d3be39-e93a-4829-9bf6-1bbadd6c46ea req-e5235d21-20e2-4bd1-85ad-433cb62a1a79 service nova] Creating event network-vif-deleted:cbb5c9a7-7a07-432e-89aa-f4407605275f for instance 25980179-c2e1-4578-858d-5365ade3a2d4 on hv-cinder-84773 Sep 06 20:30:15.582653 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [req-26d3be39-e93a-4829-9bf6-1bbadd6c46ea req-e5235d21-20e2-4bd1-85ad-433cb62a1a79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058662 Sep 06 20:30:15.583533 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 614/1267] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 6 20:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 20:30:16.047273 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:16.048264 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:16.056594 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:16.057870 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:16.058472 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:16.059557 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:16.060272 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:16.060808 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:16.126409 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:16.127007 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:16.127526 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:16.128227 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.objects.instance [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lazy-loading 'fault' on Instance uuid 25980179-c2e1-4578-858d-5365ade3a2d4 {{(pid=120952) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 20:30:16.179711 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.policy [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f661aa1f00e4c7e916b2498505475dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4697b9e0a940b284b392b3e93197c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120952) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 20:30:16.193933 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-cf7157cb-b9d2-47bc-bf2f-ff8032f1b4f7 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 200 len: 1230 microversion: 2.1 time: 0.152637 Sep 06 20:30:16.194901 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 654/1268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:16 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 1230 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 20:30:17.233851 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:17.234971 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: 25980179-c2e1-4578-858d-5365ade3a2d4] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:17.242743 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:17.243322 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:17.243762 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:17.244483 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:17.244940 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:17.245359 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:17.261998 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] HTTP exception thrown: Instance 25980179-c2e1-4578-858d-5365ade3a2d4 could not be found. Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Request method failure captured: Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 HTTP/1.1 Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6wdOq2sUsiT5usZ2Rji6yHTKGgvpyGisl7-F-v1tYYF8GLFMe6h6ZUDA8CuDIR5TkYFqkcjuiKM38JXFwiFuX8puKmDFSQu2okc6PUKtFFrH3TwkWok14q6qnt3eVtkkCpDkKM_R45QXErPEeZ2Gmxi5meuvrleOIKhHzQRMJTrYNo Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:30:17.264403 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 7f661aa1f00e4c7e916b2498505475dc Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance 25980179-c2e1-4578-858d-5365ade3a2d4 could not be found. Sep 06 20:30:17.267779 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': '25980179-c2e1-4578-858d-5365ade3a2d4'} Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25980179-c2e1-4578-858d-5365ade3a2d4 could not be found. Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:30:17.269786 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25980179-c2e1-4578-858d-5365ade3a2d4 could not be found. Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25980179-c2e1-4578-858d-5365ade3a2d4 could not be found. Sep 06 20:30:17.273170 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:17.276621 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Returning 404 to user: Instance 25980179-c2e1-4578-858d-5365ade3a2d4 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:30:17.276621 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-e99df137-f28f-4f00-9e1f-7545c6450dcb tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4" status: 404 len: 111 microversion: 2.1 time: 0.037095 Sep 06 20:30:17.276621 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 615/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:17 2022] GET /compute/v2.1/servers/25980179-c2e1-4578-858d-5365ade3a2d4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 20:30:17.970305 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:17.971235 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.compute.api [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120952) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:17.978519 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:17.979078 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:17.979560 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:17.980337 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:17.981002 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:17.981448 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG oslo_concurrency.lockutils [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:18.001276 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.wsgi [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] HTTP exception thrown: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Request method failure captured: Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: request: DELETE /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 HTTP/1.1 Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept: application/json Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Accept-Encoding: identity Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Connection: close Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Length: 0 Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Content-Type: application/json Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Host: 10.222.0.20 Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: Openstack-System-Scope: None Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: User-Agent: python-urllib3/1.26.12 Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Auth-Token: gAAAAABjF6wdOq2sUsiT5usZ2Rji6yHTKGgvpyGisl7-F-v1tYYF8GLFMe6h6ZUDA8CuDIR5TkYFqkcjuiKM38JXFwiFuX8puKmDFSQu2okc6PUKtFFrH3TwkWok14q6qnt3eVtkkCpDkKM_R45QXErPEeZ2Gmxi5meuvrleOIKhHzQRMJTrYNo Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Id: None Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Domain-Name: None Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Identity-Status: Confirmed Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Is-Admin-Project: True Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Id: default Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Domain-Name: Default Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Project-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Role: member,reader Sep 06 20:30:18.003243 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Roles: member,reader Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-Tenant-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Id: default Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Domain-Name: Default Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Id: 7f661aa1f00e4c7e916b2498505475dc Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: X-User-Name: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: method: > Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: exception: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.005915 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: action_args: {'id': 'd3fd9b1e-42f7-4866-9581-cd510ab72f07'} Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:30:18.007291 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.008898 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.011876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Returning 404 to user: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. {{(pid=120952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:30:18.011876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-b37e719e-896d-4b00-bb2d-77bc8354674b tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 404 len: 111 microversion: 2.1 time: 0.039640 Sep 06 20:30:18.011876 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 655/1270] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 6 20:30:17 2022] DELETE /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 20:30:18.020128 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '>' {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:18.021225 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.compute.api [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] [instance: d3fd9b1e-42f7-4866-9581-cd510ab72f07] Fetching instance by UUID {{(pid=120951) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 20:30:18.033526 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:18.034794 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:18.035609 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:18.036969 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Acquiring lock "089655f8-2bf0-4b56-ad47-918579e24a3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 20:30:18.037888 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 20:30:18.038791 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG oslo_concurrency.lockutils [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Lock "089655f8-2bf0-4b56-ad47-918579e24a3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 20:30:18.067180 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.wsgi [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] HTTP exception thrown: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Request method failure captured: Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: request: GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 HTTP/1.1 Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept: application/json Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Accept-Encoding: identity Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Connection: close Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Length: 0 Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Content-Type: application/json Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Host: 10.222.0.20 Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: Openstack-System-Scope: None Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: User-Agent: python-urllib3/1.26.12 Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Auth-Token: gAAAAABjF6wdOq2sUsiT5usZ2Rji6yHTKGgvpyGisl7-F-v1tYYF8GLFMe6h6ZUDA8CuDIR5TkYFqkcjuiKM38JXFwiFuX8puKmDFSQu2okc6PUKtFFrH3TwkWok14q6qnt3eVtkkCpDkKM_R45QXErPEeZ2Gmxi5meuvrleOIKhHzQRMJTrYNo Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Id: None Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Domain-Name: None Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Identity-Status: Confirmed Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Is-Admin-Project: True Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Id: default Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Domain-Name: Default Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Project-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Role: member,reader Sep 06 20:30:18.070307 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Roles: member,reader Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed4697b9e0a940b284b392b3e93197c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}] Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Id: ed4697b9e0a940b284b392b3e93197c7 Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-Tenant-Name: tempest-TestVolumeBootPattern-57222979 Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Id: default Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Domain-Name: Default Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Id: 7f661aa1f00e4c7e916b2498505475dc Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: X-User-Name: tempest-TestVolumeBootPattern-57222979-project Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: method: > Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: exception: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.073216 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: action_args: {'id': 'd3fd9b1e-42f7-4866-9581-cd510ab72f07'} Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: {{(pid=120951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 20:30:18.078068 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. Sep 06 20:30:18.081123 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: ERROR nova.api.openstack.wsgi Sep 06 20:30:18.084802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: DEBUG nova.api.openstack.wsgi [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Returning 404 to user: Instance d3fd9b1e-42f7-4866-9581-cd510ab72f07 could not be found. {{(pid=120951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 20:30:18.084802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: INFO nova.api.openstack.requestlog [None req-d104f887-7a85-4368-adcb-4c21c412b4cc tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07" status: 404 len: 111 microversion: 2.1 time: 0.061434 Sep 06 20:30:18.084802 dv-cinder-847732-4-iscsi devstack@n-api.service[120951]: [pid: 120951|app: 0|req: 616/1271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 6 20:30:18 2022] GET /compute/v2.1/servers/d3fd9b1e-42f7-4866-9581-cd510ab72f07 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 20:30:19.533832 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: DEBUG nova.api.openstack.wsgi [None req-5db4c768-2daa-4dfc-94f2-056e8da04ff4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] Calling method '.version_select at 0x7f9c379721f0>' {{(pid=120952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 20:30:19.571301 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: INFO nova.api.openstack.requestlog [None req-5db4c768-2daa-4dfc-94f2-056e8da04ff4 tempest-TestVolumeBootPattern-57222979 tempest-TestVolumeBootPattern-57222979-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-556363554" status: 202 len: 0 microversion: 2.1 time: 0.044322 Sep 06 20:30:19.573821 dv-cinder-847732-4-iscsi devstack@n-api.service[120952]: [pid: 120952|app: 0|req: 656/1272] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Sep 6 20:30:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-556363554 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)